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ABSTRACT 



The 1998 NAEP (National Assessment of Educational Progress) 



state level reading assessment measured fourth- and eighth-grade students' 
reading proficiency in situations that involved reading for three purposes: 
reading for literary experience, reading to gain information, and reading to 
perform a task (grade 8 only) . This report describes the reading proficiency 
of Massachusetts fourth- and eighth-grade public school students and 
fourth-grade nonpublic school students and compares their overall performance 
to students in the Southeast region of the United States and the nation 
(using data from the NAEP national assessments) . The distribution of reading 
results and reading achievement level results are provided for subpopulations 
of students (gender, race/ethnicity, students' reports of parents' highest 
educational level, free/reduced-price lunch program eligibility, and type of 
location) . The average reading proficiency of fourth-grade public school 
students in Massachusetts on the NAEP reading scale was 225 compared to 215 
nationwide; 233 compared to 233 nationwide for fourth-grade nonpublic school 
students; and 269 to 261 nationwide for eighth-grade public school students. 
(RS) 
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What is The Nation's Report Card? 

THE NATION’S REPORT CARD, the National Assessment of Educational Progress (NAEP), is the only nationally 
representative and continuing assessment of what America’s students know and can do in various subject areas. Since 1969, 
assessments have been conducted periodically in reading, mathematics, science, writing, history, geography, and other 
fields. By making objective information on student performance available to policymakers at the national, state, and local 
levels, NAEP is an integral part of our nation’s evaluation of the condition and progress of education. Only information 
related to academic achievement is collected under this program. NAEP guarantees the privacy of individual students and 
their families. 

NAEP is a congressionally mandated project of the National Center for Education Statistics, the U.S. Department of 
Education. The Commissioner of Education Statistics is responsible, by law, for carrying out the NAEP project through 
competitive awards to qualified organizations. NAEP reports directly to the Commissioner, who is also responsible 
for providing continuing reviews, including validation studies and solicitation of public comment, on NAEP’s conduct 
and usefulness. * — 

In 1988, Congress established the National Assessment Governing Board (NAGB) to formulate policy guidelines for 
NAEP. The Board is responsible for selecting the subject areas to be assessed from among those included in the National 
Education Goals; for setting appropriate student performance levels; for developing assessment objectives and test 
specifications through a national consensus approach; for designing the assessment methodology; for developing guidelines 
for reporting and disseminating NAEP results; for developing standards and procedures for interstate, regional, and national 
comparisons; for determining the appropriateness of test items and ensuring they are free from bias; and for taking actions 
to improve the form and use of the National Assessment. 
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SECTION 1 



Overview of the NAEP Reading 
Assessment 



What Is NAEP? 

The National Assessment of Educational Progress (NAEP) is the only nationally 
representative and continuing assessment of what students in the United States know and 
can do in various academic subjects. NAEP is authorized by Congress and directed by 
the National Center for Education Statistics (NCES). The National Assessment 
Governing Board (NAGB), an independent body, provides policy guidance for NAEP. 
The NAEP assessments are administered to representative samples of students at the 
national level as well as at the state level for those states that want to participate. To 
ensure comparability in a particular subject across all jurisdictions, NCES has 
established guidelines for school and student participation rates. These guidelines, as 
well as other technical aspects of the assessment, are detailed in the NAEP 1998 Reading 
Report Card.' 

The 1998 NAEP program included state-level assessments in reading at grades 4 
and 8 and in writing at grade 8, and national -level assessments in civics, reading, and 
writing at grades 4, 8, and 12. This report and its companion, the NAEP 1998 Reading 
Report Card, provide a first look at the results of the NAEP 1998 reading assessment. 
The Reading Report Card offers additional state-level data. Each participating 
jurisdiction receives its own customized State Report identical in format to this one. 
Summary data tables providing information for all jurisdictions for which results are 
reported in 1998 are available at http://nces.ed.gov/naep/, the NAEP Web site. 

What Is Reported Here? 

The NAEP reading assessment has been administered at the state level three times: in 
public schools at grade 4 in 1992, in public and nonpublic schools at grade 4 in 1994, 
and in public and nonpublic schools at grades 4 and 8 in 1998. Massachusetts 
participated in the 1998 NAEP reading assessment at grades 4 and 8. Both public and 
nonpublic schools participated. However, nonpublic schools failed to meet minimum 
participation guidelines for publication at grade 8. Massachusetts also participated in 
the NAEP reading assessments in 1992 and 1994. Massachusetts’ public school results 
for 1992, 1994, and 1998 and grade 4 nonpublic school results for 1994 and 1998 are 
presented here, along with national and regional results for comparison. 

This report has two sections. This Overview provides basic information on NAEP 
and the overall results for public schools in graphic form. It describes the assessment, 
the sample of students assessed, the metrics for reporting student performance, and how 
the differences in performance are reported. The second section, Overall Reading 
Performance and Performance by Demographic Characteristics, reports findings for 
the entire public school population at grades 4 and 8 as well as for the population broken 
out by major demographic categories and school type. This information is presented in 
data tables. 

1 Donahue, P, L„ Voelkl, K. E., Campbell, J. R., and Mazzeo, J. (1999). The NAEP J998 reading report card for the 
nation and the states (NCES Publication No. 1999-500). Washington, DC: National Center for Education Statistics. 
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In addition, this report has two appendices. Appendix A, Where to Find More 
Information, describes the data available on the Web and provides information on 
sources of related data. Appendix B, Figures from Section 1 , displays full-page 
replicas of Figures 1-5. 

The demographic data provided in this report are only a small portion of the data 
available from the several hundred questions asked of students, teachers, and school 
principals in order to provide context for NAEP results. Overall results for all student 
and school variables for public school students in each participating jurisdiction are 
available in summary data tables at the NAEP Web site. 

How Are Results Reported? 

In this report, as in other NAEP reports, only those results based on preestablished 
minimum sample sizes are reported. For details, see the forthcoming NAEP 1998 
Technical Report. The results are reported in terms of two metrics, descriptions of which 
follow and details of which can be found in the Reading Report Card. 

• Average NAEP reading scale scores are reported for all students or for subgroups 
of students. 

• Percentages of students in each achievement level; that is, the students’ scale 
scores place them into three categories: at or above the Basic level, at or above the 
Proficient level, and at the Advanced level. Also reported are the percentages of 
students whose scores are below the Basic level. 

The bulleted statements in the text as well as the symbols in the tables are based 
on the results of statistical tests of the data. The reader is cautioned to rely on the results 
of these statistical tests rather than on the apparent magnitude of any difference in scale 
scores or percentages in making inferences from the data. 

The NAEP Reading Scale 

Students’ responses to the NAEP 1998 reading assessment were analyzed to determine 
the percentages of students responding correctly to each multiple-choice question or in 
each of several score categories for constructed-response questions (requiring a short or 
long written answer). Three scales were developed, one for each of the three purposes 
for reading: reading for literary experience; reading to gain information ; and reading to 
perform a task (grades 8 and 12 only). The purposes for reading are described fully in 
the companion Reading Report Card and in the Reading Framework for the National 
Assessment of Educational Progress , 2 both available on the Web (see Appendix A). 
Student performance by each of the purposes for reading appears in the percentile data 
tables at the NAEP Web site. The scales summarize results across all three grades. The 
scale for each of the purposes for reading ranges from 0 to 500 and is linked to its 
corresponding scale from 1992 and 1994. An overall composite scale was developed 
by weighting each of the three subscales based on its relative importance in the NAEP 
reading framework. This composite scale is the metric used to present the average scale 
scores and selected percentiles in this and other reports. 



2 National Assessment Governing Board. (1993). Reading framework for the National Assessment of Educational 
Progress: 1992-1998. Washington, DC: Author. 
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The Reading Achievement Levels 

In addition to the NAEP reading scale, results are also reported in terms of the reading 
achievement levels authorized by the NAEP legislation 3 and adopted by the National 
Assessment Governing Board. The achievement levels are performance standards based 
on the collective judgments about what students should be expected to know and to do. 
Viewing students’ performance from this perspective provides some insight into the 
adequacy of students’ knowledge and skills and the extent to which they achieved 
expected levels of performance. The Board reviewed and adopted the recommended 
achievement levels derived from the judgments of a broadly representative panel that 
included teachers, education specialists, and members of the general public. 

For each grade tested, the Board has adopted three achievement levels: Basic, 
Proficient, and Advanced. For reporting purposes, the achievement level cut scores for 
each grade represent the boundaries between four ranges on the NAEP reading scale: 
below Basic, Basic, Proficient, and Advanced. The policy definitions of the achievement 
levels are shown below. The text of the descriptions of expected reading performance 
at each achievement level at grades 4 and 8 can be found under the heading What 
Should Students Be Able to Do? later in this section. The cut scores that divide the 
achievement levels can be found in the footnotes of the tables in Section 2. 



Definitions of the achievement levels 

Basic Partial mastery of prerequisite knowledge and skills that are fundamental 
for proficient work at each grade 

Proficient Solid academic performance for each grade assessed. Students reaching 
this level have demonstrated competency over challenging subject matter, 
including subject-matter knowledge, application of such knowledge to real- 
world situations, and analytical skills appropriate to the subject matter. 

Advanced Superior performance 



The NAEP legislation requires that the achievement levels be used on a 
developmental basis until the Commissioner of Education Statistics determines, as the 
result of a congressionally mandated evaluation by one or more nationally recognized 
evaluation organizations, that the achievement levels are “reasonable, valid, and 
informative to the public.” Upon review of the available information, the Commissioner 
of Education Statistics agrees with the National Academy’s recommendation that caution 
needs to be exercised in the use of the current achievement levels, since in the opinion 
of the Academy “... appropriate validity evidence for the cut scores is lacking; and the 
process has produced unreasonable results.” 4 Therefore, the Commissioner concludes 
that these achievement levels should continue to be considered developmental and 
should continue to be interpreted and used with caution. The Reading Report Card 
contains further information on the developmental status of the achievement levels. The 
Commissioner and the Governing Board believe that the achievement levels are useful 
for reporting trends in the educational achievement of students in the United States. 



3 The National Education Statistics Act of 1994 requires that the National Assessment Governing Board develop 
“appropriate student performance levels” for reporting NAEP results. 

4 Pelligrino, J. W., Jones, L. R., and Mitchell, K. J. (Eds.). (1999). Grading the nation's report card: Evaluating NAEP 
and transforming the assessment of educational progress (p. 182). Committee on the Evaluation of the National and 
State Assessments of Educational Progress, Board on Testing and Assessment, Commission on Behavioral and Social 
Sciences and Education, National Research Council. Washington, DC: National Academy Press. 
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Reading Scale Score Results for Public School Students 

Figure 1 on the following page shows graphically Massachusetts’ performance in terms 
of average scale scores as compared to that of the Northeast region and the nation. Note 
that only a small portion of the NAEP reading scale, which actually ranges from 0 to 
500, is represented on the vertical axis. 

Public School Students, Grade 4 

• In 1998, the average reading scale score of students in Massachusetts was 225. This 
was higher than that of students across the nation (215). 

• In Massachusetts, the average scale score of students was not significantly different 
in 1998 (225) from that in 1992 (226). Similarly, the average scale score of fourth 
graders across the nation was not significantly different in 1998 (215) from that in 
1992 (215). 

• In Massachusetts, the average scale score of students was not significantly different 
in 1998 (225) from that in 1994 (223). However, the average scale score of fourth 
graders across the nation was higher in 1998 (215) than in 1994 (212). 

Public School Students, Grade 8 

• In Massachusetts, the average reading scale score was 269 in 1998, higher than that 
of students across the nation (261). 

The bulleted statements above give only a few of the assessment’s findings. Complete 
notations of significant differences in overall performance for 1992 as compared to 1998 
and for 1994 as compared to 1998 can be found in Table 1A in Section 2. Note that 
the changes indicated between two particular years show differences in performance 
between two distinct points in time and are not meant to indicate a general trend through 
the intervening years. Additional information can be found in the NAEP 1998 Reading 
Report Card and on the NAEP Web site. Differences between 1994 and 1992 are not 
shown in this report; they can be found in the NAEP 1994 Reading State Report for 
Massachusetts. 
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How to read Figure 1 

The vertical bars in Figure 1 show reading scores at grade 4 for 1992, 1994, and 
1998, and at grade 8 for 1998, along only a portion of the NAEP 0-500 reading 
scale. The NAEP reading scale is a cross-grade scale (that is, it covers all three 
grades), so the difference between the performance of fourth graders and eighth 
graders can be observed. The reader must be sure to look at the actual scores (on 
top of the bars) rather than at the comparative heights of the bars when comparing 
performance for the two grades. (Table 1A in Section 2 also shows these scores, 
their associated standard errors, and the scores’ distribution at selected percentiles.) 

Massachusetts’ overall average scale score is followed by those for the Northeast 
region and for the nation. The regional and national data come from the national 
sample, which is a different sample from that providing the state data. However, 
through linking procedures, state and national reading results are placed on the 
same scale. 
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Average reading scale scores for public school students at grades 4 and 8 


State Assessment 
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SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP). 1992, 1994, and 1998 Reading Assessments. 
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Achievement Level Results for Public School Students 

Figure 2 on the following page shows graphically Massachusetts’ performance in terms 
of achievement levels (see page 3 for a description) as compared to that of the Northeast 
region and the nation. 



• In 1998, the percentage of Massachusetts students who performed at or above the 
Proficient level was 37 percent. This percentage was greater than the percentage 
of the nation’s students who performed at the same level (29 percent). 

• The percentage of students performing at or above the Proficient level in 
Massachusetts did not differ significantly in 1998 (37 percent) from that in 1992 
(36 percent). 

• The percentage of students performing at or above the Proficient level in 
Massachusetts did not differ significantly in 1998 (37 percent) from that in 1994 
(36 percent). 



• In 1998, the percentage of students who performed at or above the Proficient level 
in Massachusetts was 36 percent. This percentage was greater than that of students 
across the nation (3 1 percent). 

The bulleted statements above give only a few of the assessment’s findings. Complete 
notations of significant changes in overall performance for 1992 as compared with 1998 
and for 1994 as compared with 1998 can be found in Table IB in Section 2. Notations 
of significant changes between 1994 and 1992 can be found in the NAEP 1994 Reading 
State Report for Massachusetts. 



Figure 2 shows the percentages of fourth- and eighth-grade students whose scores 
on the NAEP reading assessment placed them into each of the three achievement 
levels, or into the range below the Basic achievement level. In order to place 
students in the achievement level categories, scale score cutpoints were set for each 
level at each grade in 1992, the first year of the assessment. The process of 
determining the achievement levels is under development; thus, they should be used 
and interpreted with caution. The Introduction to the NAEP 1998 Reading Report 
Card contains further information on the developmental status of achievement levels. 

To assist comparisons of performance across the years or comparisons at the state, 
regional, and national levels, the bars are centered between the top of the Basic 
category and the beginning of the Proficient category. There is a vertical line 
representing 0 percent through this location. A visual comparison of the 
percentages of students performing at or above the Proficient level in the jurisdiction 
and the nation can be made by comparing the extension of the bars to the right of 
the zero axis. 



Public School Students , Grade 4 



Public School Students , Grade 8 



How to read Figure 2 




6 



NAEP 1998 READING STATE REPORT 



Massachusetts 



THE 1* 
REPORT 
CARD 

1888 


lATION’S 

rcaep 




FIGURE 2 


Reading achievement level results for public school students at grades 4 
and 8 


State Assessment 



The bars below contain estimated percentages of students in each NAEP reading achievement category. Each population 
of students is aligned at the point where the Proficient category begins, so that they may be compared at Proficient and above. 
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SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992, 1994, and 1998 Reading Assessments. 



The text and tables in this report refer to the percentage of students who score “at 
or above Proficient” and “at or above Basic” These percentages are cumulative. For 
instance, in Table IB in Section 2, “at or above Proficient ” appears as a single 
percentage. In order to compare the percentage in Figures 2, 4, and 5 with that in 
Table IB, the percentage appearing in the Proficient band in the figures must be added 
to the percentage in the Advanced band to obtain the percentage of students whose scores 
categorize them as “at or above Proficient” Similarly, the sum of the percentages 
appearing in the Basic , Proficient , and Advanced bands yields the percentage of students 
“at or above Basic.” 

Figures 2, 4, and 5 allow one to compare performance by the total percentage of 
a given student population whose scores put the students in the broad category “at or 
above Proficient ” (that is, simply comparing bar lengths to the right of the zero axis). 
Other interesting comparisons might consider the components of the bar lengths. For 
instance, one student population with 40 percent of its members performing at or above 
Proficient could have 35 percent at Proficient and 5 percent at Advanced. Another 
student population, also with 40 percent of its members performing at or above 
Proficient , might have 25 percent at Proficient and 15 percent at Advanced. In a similar 
manner, on the left side of the zero axis, much can be gained by comparing the 
percentage of students performing at the Basic level with the percentage below the Basic 
level. 
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Comparisons Between Massachusetts and Other 
Participating Jurisdictions 

In 1998, 45 states and other jurisdictions participated in the reading assessment. Of 
those, 43 at grade 4 and 40 at grade 8 met statistical reporting requirements for 
publishing their public school students’ performance on the NAEP reading assessment. 
The maps in Figure 3 show the participating states and indicate their membership in four 
U.S. geographic regions. Note that the Virgin Islands and the domestic and overseas 
Department of Defense Education Activity schools (DoDEA/DDESS and 
DoDEA/DoDDS) do not belong to any of these regions. Reading results for all 
participating states and other jurisdictions are available at the NAEP Web site. 



Average scale scores: How to read Figure 3 

Figure 3 presents maps comparing Massachusetts’ overall 1998 grade 4 and grade 
8 reading scale scores with those of all other participating states and jurisdictions. 
The different shadings are determined by whether or not Massachusetts’ average 
scale score is significantly different (in a statistical sense) from that of each of the 
other participants in the 1998 NAEP state reading assessment. States that did not 
participate in 1998, or that did not meet reporting guidelines, are also represented 
in the maps. 



Achievement levels: How to read Figures 4 and 5 

Figures 4 and 5 permit comparisons of all participants in the NAEP state 
assessment, in terms of percentages of public school students performing at or 
above the Proficient level as well as those performing at the Basic level and below. 
As with Figure 3, the participating jurisdictions are arranged into categories reflecting 
student performance compared to that in Massachusetts. The jurisdictions are 
grouped by whether the percentage of their students with scores at or above the 
Proficient level (including Advancecf) was higher than, not significantly different from, 
or lower than the percentage in Massachusetts. Note that the arrangement of the 
states and other jurisdictions within each category is alphabetical; statistical 
comparisons among the jurisdictions in each of the three groups are not included 
here. 



These figures are available in color at the NAEP Web site. In the companion 
Reading Report Card , there are additional data tables as well as multiple comparison 
charts permitting comparison of each participating jurisdiction with all others. 
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Massachusetts’ 1998 average reading scale score compared to those for other 
participating jurisdictions for public school students at grades 4 and 8 


State Assessment 
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[ | State did not participate In the NAEP 1998 Reading State Aasesament Differences between states and other jurisdictions may be partially explained by other factors not included in this figure. 



SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1998 Reading Assessment. 
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o 

ERIC 



BEST COPY AVAILABLE 



NAEP 1998 READING STATE REPORT 



15 



9 



Massachusetts 



THE NATION’S 
REPORT 
CARD 



1998 



rasp 

B 



State Assessment 



FIGURE 4 



Achievement levels for reading: Comparing the percentage of public school 
students at or above the Proficient level in Massachusetts with those in other 
participating jurisdictions at grade 4 in 1998 



The bars below contain estimated percentages of students in each NAEP reading achievement category. Each population 
of students is aligned at the point where the Proficient category begins, so that they may be compared at Proficient and above. 
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Differences between states and other jurisdictions may be partially explained by other factors not included in this figure. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1998 Reading Assessment. 
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FIGURE 5 

Achievement levels for reading: Comparing the percentage of public school 
students at or above the Proficient level in Massachusetts with those in other 
participating jurisdictions at grade 8 in 1998 



The bars below contain estimated percentages of students in each NAEP reading achievement category. Each population 
of students is aligned at the point where the Proficient category begins, so that they may be compared at Proficient and above. 
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Differences between states and other jurisdictions may be partially explained by other factors not included in this figure. 



SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1998 Reading Assessment. 
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What Was Assessed? 

The subject area content for each NAEP assessment is developed through a 
congressionally mandated national consensus process directed by the National 
Assessment Governing Board (NAGB). The objectives for each NAEP assessment are 
described in a framework document that delineates the important content and process 
areas to be measured, as well as the types of exercises to be included in the assessment. 

The Reading Framework for the 1992 and 1994 NAEP reading assessments also 
guided the 1998 reading assessment. This framework was developed under the auspices 
of the Council of Chief State School Officers (CCSSO). Reflecting current theories of 
reading, the Reading Framework describes reading as a complex interaction among the 
reader, the text, and the context of the reading situation. According to this interactive 
view of reading, readers use different strategies and processes depending on the type 
of text being read and the purposes for reading it. 

The framework specifies that students be assessed in reading for three different 
purposes: reading for literary experience , reading to gain information , and reading to 
perform a task. The last purpose is not assessed at grade 4. In order to measure 
students’ abilities to read for different purposes, the assessment is composed of three 
different types of texts, each associated with one purpose for reading. 

While responding to text, readers take different approaches in order to understand 
what is being read. The comprehension process typically involves changing stances, or 
orientations toward the text. The framework describes four reading stances: initial 
understanding , developing an interpretation , personal response , and critical stance. 
These stances are not intended to represent a sequential routine of reading abilities nor 
are they considered hierarchical; rather, they describe reading processes that all readers 
use at any level of development. 

The assessment contains reading materials that were drawn from sources 
commonly available to students in and out of school. These authentic materials were 
considered to be representative of the types of reading experiences typically encountered 
by students. Each student in the state assessment was asked to complete two 25-minute 
blocks, each consisting of a reading passage and associated comprehension questions at 
the appropriate grade level. A combination of multiple-choice and constructed-response 
questions was used to assess students’ understanding of the passages. The passages and 
associated items followed a distribution specified by the framework. 



Distribution of items by purpose for reading 
as specified by the Reading Framework 



Purpose 


Grade 4 


Grade 8 


For literary experience 


55% 


40% 


To gain information 


45% 


40% 


To perform a task 


(none) 


20% 
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What Should Students Be Able to Do? 

The following grade-specific achievement level descriptions focus on the interaction of 
the reader, the text, and the context. The achievement level descriptions reflect what 
readers performing at each achievement level should be able to do. The achievement 
levels are cumulative from Basic to Proficient to Advanced. Each level builds on the 
previous level such that knowledge at the Proficient level presumes mastery of the Basic 
level, and knowledge at the Advanced level presumes mastery of both the Basic and 
Proficient levels. 
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FIGURE 6A 



Levels of Reading Achievement at Grade 4 



BASIC 

LEVEL 

(208) 



Fourth-grade students performing at the Basic level should demonstrate an 
understanding of the overall meaning of what they read. When reading text 
appropriate for fourth graders, they should be able to make relatively obvious 
connections between the text and their own experiences and extend the ideas in 
the text by making simple inferences. 



PROFICIENT 

LEVEL 

(238) 



Fourth-grade students performing at the Proficient level should be able to 
demonstrate an overall understanding of the text, providing inferential as well as 
literal information. When reading text appropriate to fourth grade, they should be 
able to extend the ideas in the text by making inferences, drawing conclusions, and 
making connections to their own experiences. The connection between the text and 
what the student infers should be clear. 



ADVANCED 

LEVEL 

(268) 



Fourth-grade students performing at the Advanced level should be able to 
generalize about topics in the reading selection and demonstrate an awareness of 
how authors compose and use literary devices. When reading text appropriate to 
fourth grade, they should be able to judge text critically and, in general, give 
thorough answers that indicate careful thought. 
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FIGURE 6B 



Levels of Reading Achievement at Grade 8 





Eighth-grade students performing at the Basic level should demonstrate a literal 


BASIC 


understanding of what they read and be able to make some interpretations. When 


LEVEL 


reading text appropriate to eighth grade, they should be able to identify specific 


aspects of the text that reflect the overall meaning, extend the ideas in the text by 


(243) 


making simple inferences, recognize and relate interpretations and connections 




among ideas in the text to personal experience, and draw conclusions based on the 




text. 



PROFICIENT 

LEVEL 

(281) 



Eighth-grade students performing at the Proficient level should be able to show an 
overall understanding of the text, including inferential as well as literal information. 
When reading text appropriate to eighth grade, they should be able to extend the 
ideas in the text by making clear inferences from it, by drawing conclusions, and 
by making connections to their own experiences— including other reading 
experiences. Proficient eighth graders should be able to identify some of the 
devices authors use in composing text. 



ADVANCED 

LEVEL 

(323) 



Eighth-grade students performing at the Advanced level should be able to describe 
the more abstract themes and ideas of the overall text. When reading text 
appropriate to eighth grade, they should be able to analyze both meaning and form 
and support their analyses explicitly with examples from the text; they should be 
able to extend text information by relating it to their experiences and to world 
events. At this level, student responses should be thorough, thoughtful, and 
extensive. 
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Who Was Assessed? 

Selection of Schools and Students 

For the NAEP state assessment, participating schools within a given jurisdiction, and 
students in those schools, were selected using probability sampling methods. These 
methods are described in the NAEP 1998 Reading Report Card. 

Massachusetts’ Participation 

The overall participation rate for schools and students must meet guidelines established 
by NCES and NAGB in order for assessment results to be reported publicly. The NAEP 
state assessment in reading was administered in public schools at grade 4 in 1992, in 
public and nonpublic schools at grade 4 in 1994, and in public and nonpublic schools 
at grades 4 and 8 in 1998. Massachusetts participated in the NAEP reading assessments 
in 1992, 1994, and 1998 at grade 4, and met the minimum guidelines for publication 
of its public school results in all years. In 1994 and 1998, Massachusetts also satisfied 
the criteria for reporting nonpublic school results at grade 4. In 1998 at grade 8 
Massachusetts met the criteria for reporting public school results but failed to meet the 
criteria for reporting nonpublic school results. Details on participation rates and 
guidelines for all participating jurisdictions can be found in Appendix A of the Reading 
Report Card. 

Possible Sources of Bias in Reported Results 

Within a certain state sample that meets the guidelines for publication of results, there 
still may exist possible sources of bias of the results due to nonparticipation of selected 
schools or due to nonparticipation of certain student groups. These possible sources of 
bias are indicated by notations and are specified and described in Appendix A of the 
Reading Report Card. Massachusetts’ public schools received one or more notations to 
indicate the possibility of bias. 

Participation by Students with Disabilities or Who Are Learning English 

NAEP endeavors to assess all students selected in the randomized sampling process 
including students with disabilities (SD) as well as students who are beginning to learn 
English and are classified by their schools as limited English proficient (LEP). Although 
the guidelines used to classify students into these two categories vary from state to state, 
NAEP criteria for inclusion standardize the selection of students. The recent Individuals 
with Disabilities Education Act (IDEA) should bring further consistency to classification 
criteria. The percentages of students classified as SD or LEP in all participating states 
and jurisdictions are available at the NAEP Web site in the all-jurisdiction summary data 
tables (SDTs). Participation guidelines specify levels of SD/LEP student 
nonparticipation that put the sample at risk for nonresponse bias; however, no 
jurisdiction failed to meet these guidelines for the 1998 reading assessment. 

NAEP offers certain accommodations for SD or LEP students who need them (for 
example, large print test booklets or extended time), as described in the NAEP 1998 
Reading Report Card and in a special report to follow. However, school personnel make 
the ultimate decision as to whether or not a particular student should take the assessment 
and whether accommodations are needed. The following table shows the percentage 
of students in Massachusetts who were classified as SD or LEP in 1998 and also the 
percentage of those students who were excluded from NAEP at the discretion of school 
personnel. 
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Students in Massachusetts who are classified as 


limited English proficient (LEP) or having disabilities, 1998 


Percentage of students who are: 




School Type 


Grade 4 


Public 


Nonpublic 


Classified as LEP 


4% 


3% 


Excluded from the assessment due to LEP 


2% 


2% 


Classified as students with disabilities 


17% 


1% 


Excluded from the assessment due to disability 

Grade 8 


7% 


1% 


Classified as LEP 


2% 


... 


Excluded from the assessment due to LEP 


1% 




Classified as students with disabilities 


14% 


... 


Excluded from the assessment due to disability 


5% 


— 



— Nonpublic schools did not participate or minimum participation guidelines were not met. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1998 
Reading Assessment. 
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How Are Performance Differences Reported? 

Because the percentages of students and the average reading scale scores presented in 
this report are based on samples — rather than on the entire population of fourth or eighth 
graders in a jurisdiction — the numbers reported are necessarily estimates . As such, they 
are subject to sampling error, a measure of uncertainty reflected in the standard 
error 1 of the estimate. When the percentages or average scale scores of certain groups 
are compared, it is essential to take the standard error into account rather than to rely 
solely on observed similarities or differences. The comparisons discussed in this report 
are based on statistical tests that consider both the magnitude of the differences between 
the averages or percentages and the standard errors of those statistics. 

The statistical tests determine whether the evidence — based on the data from the 
groups in the sample — is strong enough to conclude that there is an actual difference in 
the averages or percentages for those groups in the population. If the evidence is strong 
(i.e., the difference is statistically significant), the report describes the group averages 
or percentages as being different (e.g., one group performed higher than or lower than 
another group) regardless of whether the sample averages or percentages appear to be 
about the same or not. If the evidence is not sufficiently strong (i.e., the difference is 
not statistically significant), the averages or percentages are described as being not 
significantly different — again, regardless of whether the sample averages or sample 
percentages appear to be about the same or widely discrepant. 

In this report, statements that compare groups or years by using terms such as 
“higher” or “no significant difference” (e.g., “females scored higher than males” or 
“scores in 1998 were not significantly different from 1994”) are based on the results of 
statistical tests. Change over time that is statistically significant is indicated in the 
tables. The reader is cautioned to rely on the results of the statistical tests (as expressed 
in the bulleted text or as indicated in the tables) rather than on the apparent magnitude 
of any difference in scale scores or percentages in making inferences from the data. 

The statistical tests are discussed in greater detail in the NAEP 1998 Reading Report 
Card and the forthcoming NAEP 1998 Technical Report. 

22 

5 Standard errors measure the uncertainty that another sample drawn from the same population could have yielded 
somewhat different results. 
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SECTION 2 



Overall Reading Performance 
and Performance by 
Demographic Characteristics 



Since its inception in 1969, NAEP’s mission has been to collect, analyze, and produce 
valid and reliable information about the academic performance of students in the United 
States in various learning areas. In 1990, the mission of NAEP was expanded to provide 
state-by-state results on academic achievement. To provide reports with each state’s 
data, the computer-generated reporting system was developed; this report was produced 
using that system. 

From 1990 through 1996, NAEP provided state reports with a variety of variables 
chosen for their general interest to most states. Because of new Internet capabilities, 
and with the approval of the state NAEP representatives, the 1998 state reports are 
tailored to provide information of most immediate need to all states. Consequently, 
results are reported here by total population and broken out by major demographic 
variables only. State NAEP results on the Internet provide resources for customized 
reports not possible in the past. 

Reported in this section are the results for student performance overall as well as 
disaggregated by the main demographic variables usually reported by NAEP: 

• Gender 

• Race/ethnicity 

• Highest level of parental education (grade 8 only) 

• Eligibility for the free or reduced-price school lunch program 

• Type of school location (where applicable) 

• Type of school (public compared to nonpublic, where available) 

Each of these variables is reported first by average scale score and selected percentiles 
and then by percentages of students at or above each achievement level. 

The reader is cautioned against making inferences about the performance of 
students in these groups, or about the effectiveness of the National School Lunch 
Program or types of school control, because there are generally many other factors 
involved that are not discussed here and possibly not addressed by NAEP. 
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Students’ Overall Scale Scores 

Table 1A shows the overall performance of Massachusetts’ public school students, as 
well as the overall performance for the Northeast region and the nation. The first 
column of results gives the average scale score on the NAEP 0-500 reading scale. 

The columns to the right show the score at each of the selected percentiles. This 
arrangement permits a more detailed view of performance along the distribution of 
lowest to highest scores, with the score at each percentile as a demarcation point — for 
each percentile, that percentage of scores falls below the score at that percentile. For 
instance, 75 percent of the student scores fall below the score shown at the 
75th percentile. If, for a particular jurisdiction, the score at the 75th percentile is equal 
to the national average, 25 percent of its students performed better than the national 
average. A jurisdiction might also compare the score at its 25th percentile for the 
current year to that of a previous year to see what change has occurred for students who 
scored in the lower quartile. 

In terms of the average NAEP reading scale score for Massachusetts’ public school 
students, Table 1A shows the following. 

Public School Students , Grade 4 

• In 1998, the average reading scale score for students in Massachusetts was 225. This 
was higher than that of fourth graders in public schools across the nation (215). 

• In Massachusetts, the average scale score of students was not significantly different 
in 1998 (225) from that in 1992 (226). Similarly, the average scale score of fourth 
graders across the nation was not significantly different in 1998 (215) from that in 
1992 (215). 

• In Massachusetts, the average scale score of students was not significantly different 
in 1998 (225) from that in 1994 (223). However, the average scale score of fourth 
graders across the nation was higher in 1998 (215) than in 1994 (212). 

Public School Students , Grade 8 

• In 1998, the average scale score of students in Massachusetts was 269, higher than 
that of eighth graders in public schools nationwide (261). 
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TABLE 1 A 



Average reading scale scores and selected percentiles for public 
school students: 1992 to 1998 



Average 

scale 

score 




Scale score distribution 


10th 

percentile 


25th 

percentile 


50th 

percentile 


75th 

percentile 


90th 

percentile 



Grade 4 


























1998 


Massachusetts 


225 { 


: i4) 


184 < 


:3.2> 


206 ( 


: 1-9) 


227 { 


[ 14) 


248 I 


(1-6) 


265 I 


(1-4) 




Northeast 


225 { 


: i.6)> 


180 < 


: 3.2)> 


202 ( 


: 2.2)> 


227 { 


( 2.0)> 


250 I 


[1-8)> 


267 I 


(2.5) 




Nation 


215 < 


: o.8)> 


165 { 


: 2.2)> 


192 ( 


;i.D> 


218 I 


(0.9) 


242 | 


[ 10) 


261 I 


(1.3) 


1994 


Massachusetts 


223 { 


: i.3) 


177 < 


: 2.3) 


202 { 


[ 3.0) 


226 < 


[ 1-6) 


248 1 


(1.6) 


265 I 


(2.1) 




Northeast 


212 { 


:2.2) 


154 { 


: 4.8) 


186 1 


[3.6) 


217 { 


(2.3) 


242 1 


(2.8) 


261 < 


(2.4) 




Nation 


212 { 


: i.i) 


156 < 


: 2.i) 


187 \ 


[1.5) 


217 { 


[ 1-2) 


241 1 


( 1-2) 


261 < 


[1.5) 


1992 


Massachusetts 


226 { 


: o.9) 


188 I 


(1.7) 


207 I 


[ 1-6) 


228 1 


(1.3) 


247 1 


(0.9) 


263 1 


(2.2) 




Northeast 


220 { 


[3.9) 


173 1 


(5.7) 


196 < 


[5.7) 


222 1 


(5.0) 


246 1 


(3.9) 


266 1 


(6.9) 




Nation 


215 { 


; i .o) 


168 < 


(1.9) 


192 \ 


[ i.o) 


217 1 


(1.7) 


240 1 


( 1-3) 


259 1 


(2.3) 


Grade 8 


























1998 


Massachusetts 


269 1 


( 1-6) 


228 1 


(2.2) 


249 < 


[2.0) 


271 1 


(1.7) 


291 l 


( 1-6) 


co 

o 

oo 


(1-6) 




Northeast 


267 1 


( 1-7) 


222 1 


(3.8) 


246 1 


(1.5) 


270 1 


( 19) 


291 i 


(2.9) 


co 

o 

•'vl 


(3.0) 




Nation 


261 1 


(0.8) 


215 1 


(1.6) 


239 1 


(1-3) 


264 1 


( ED 


286 ( 


(0.8) 


304 l 


( 1-2) 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics in the table appear in parentheses. 
If the notation >(<) appears, it signifies that the 1998 value was significantly higher (lower) than the value for 1994 at 
about the 95 percent confidence level. If the notation »(«) appears, it signifies that the 1998 value was significantly higher 
(lower) than the value for 1992 at about the 95 percent confidence level. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992, 1994, 
and 1998 Reading Assessments. 
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Overall Results in Terms of Achievement Levels 

Table IB presents the percentages of students who performed below Basic, at or above 
Basic, at or above Proficient, and at Advanced levels. Because the percentages in the 
levels are cumulative from Basic to Proficient to Advanced, they sum to more than 100 
percent. Only the percentage of students at or above Basic (which includes Proficient 
and Advanced) plus the percentage of students below Basic will always sum to 
100 percent. 

Table IB indicates the following in terms of achievement levels attained by 
Massachusetts’ public school students. 

Public School Students, Grade 4 

• In 1998, the percentage of Massachusetts students who performed at or above the 
Proficient level was 37 percent. This was greater than the percentage of the nation’s 
public school students who performed at the same level (29 percent). 

• The percentage of students performing at or above the Proficient level in 
Massachusetts did not differ significantly in 1998 (37 percent) from that in 1992 
(36 percent). 

• The percentage of students performing at or above the Proficient level in 
Massachusetts did not differ significantly in 1998 (37 percent) from that in 1994 
(36 percent). 

• The percentage of students in Massachusetts who performed at or above the Basic 
level in 1998 (73 percent) was greater than that for the nation’s public school 
students (61 percent). 

Public School Students, Grade 8 

• The percentage of students in Massachusetts who performed at or above the 
Proficient level in 1998 was 36 percent. This percentage was greater than that of 
public school students across the nation (31 percent). 

• In 1998, the percentage of students who performed at or above the Basic level in 
Massachusetts was 80 percent. This percentage was greater than that of public 
school students nationwide (72 percent). 
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Percentages of public school students attaining achievement levels: 
1992 to 1998 



Below Basic 



At or Above 
Basic 



At or Above 
Proficient 



Advanced 



Grade 4 


















1998 


Massachusetts 


27 ( 


1.8) 


73 { 


1*8) 


37 ( 


(2.0) 


8 ( 


: o.8) 




Northeast 


30 < 


1.8)< 


70 ( 


: i.8)> 


37{ 


[ 2.0)> 


10( 


(1.3) 




Nation 


39 ( 


: 1-0) 


61 ( 


: i.o) 


29 1 


(0.9) 


6< 


: o.5) 


1994 


Massachusetts 


31 ( 


: us) 


69 ( 


(1.5) 


36 I 


(1*7) 


8 1 


( 1*0) 




Northeast 


42 ( 


: 2.3) 


58 ( 


(2.3) 


28 I 


(2.6) 


7 { 


(1.5) 




Nation 


41 ( 


: i.i) 


59 i 


(1.1) 


28 1 


( 12) 


7 { 


(0.7) 


1992 


Massachusetts 


26 { 


: i.3) 


74 1 


: i.3) 


36 l 


(1.5) 


7 { 


(0.8) 




Northeast 


35 { 


:3.9) 


65 { 


(3.9) 


32 l 


(4.7) 


9 1 


(2.6) 


Nation 

Grade 8 


40 < 


: i.i) 


60 { 


(1*1) 


27 1 


( 1*3) 


6 1 


(0.6) 


1998 


Massachusetts 


20 1 


( 1.5) 


80 1 


( 1.5) 


'' 36 i 


(2.2) 


3 I 


(0.7) 




Northeast 


22 1 


( 1.4) 


78 j 


( 1-4) 


37 i 


( 1.9) 


3 i 


(1.3) 




Nation 


28 1 


(0.9) 


72 i 


(0.9) 


31 i 


(0.9) 


2 i 


(0.4) 



The achievement levels correspond to the following points on the NAEP reading scale at grade 4 (and 8): Basic, 208-237 
(243-280); Proficient , 238-267 (281-322); and Advanced , 268 (323) and above. The standard errors of the statistics in 
the table appear in parentheses. If the notation >(<) appears, it signifies that the 1998 value was significantly higher 
(lower) than the value for 1994 at about the 95 percent confidence level. If the notation »(«) appears, it signifies that the 
1998 value was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level, 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992, 1994, 
and 1998 Reading Assessments. 
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Gender 

This report focuses on trend differences, for example, whether females’ performance has 
improved since 1994 or 1992. The indicators of significant differences that appear in 
the tables come from a comparison of performance by males or females over time. 
Another issue covered in many studies and by comparisons below (but not in the tables) 
is that of differences in performance between males and females. Several studies show 
that females outperform males in development of literacy at the elementary and middle 
school grades; reports documenting or surveying gender differences in reading include 
NAEP 1996 Trends in Academic Progress 6 and The Condition of Education. 1 

Table 2A shows scale scores for public school fourth and eighth graders by gender 
in Massachusetts, the Northeast region, and the nation. 

Scale Score Results by Gender 

In terms of average reading scale scores for Massachusetts’ public school students, 

Table 2A shows the following. 

Public School Students, Grade 4 

• In Massachusetts, male students’ average scale score was 221 in 1998. This was 
lower than that of females (229). 

• In 1998, male students in Massachusetts had an average scale score in reading (221) 
that was higher than that of fourth-grade males across the nation (212). Similarly, 
females in Massachusetts had an average score (229) that was higher than that of 
females nationwide (218). 

• The average reading scale score of Massachusetts’ fourth-grade males did not differ 
significantly in 1998 (221) from that in 1992 (225). Similarly, the average scale 
score of female students did not differ significantly in 1998 (229) from that in 1992 
(227). 

• The average reading scale score of Massachusetts’ fourth-grade males did not differ 
significantly in 1998 (221) from that in 1994 (221). Similarly, the average scale 
score of female students did not differ significantly in 1998 (229) from that in 1994 
(226). 

Public School Students, Grade 8 

• In 1998 in Massachusetts, male students’ average scale score was 263. This was 
lower than that of females (274). 

• The average reading scale score of males in Massachusetts (263) was higher than 
that of males across the nation (255) in 1998. Similarly, Massachusetts females’ 
average scale score (274) was higher than that of females nationwide (268). 
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Campbell, J., Voelkl, K., & Donahue, P. (1997). NAEP J996 trends in academic progress (NCES Publication No. 
97-985). Washington, DC: National Center for Education Statistics. 

7 For instance, see Indicator 20: U.S. Department of Education. (1996). The condition of education 1996 (NCES 
Publication No. 96-304). Washington, DC: Office of Educational Research and Improvement. 
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TABLE 2A 



Average reading scale scores and selected percentiles for public 
school students by gender: 1992 to 1998 





Percentage 
of total 
population 


Average 

scale 

score 




Scale score distribution j 






10th 

percentile 


25th 

percentile 


50th 

percentile 


75th 

percentile 


90th 

percentile 


Males 
Grade 4 
















1998 Massachusetts 


48 ( 1 .0) 


221 ( 1 .6) 


180(4.4) 


203 ( 2.2) 


224 ( 1.5) 


243 ( 1.6) 


259 ( 2.1) 


Northeast 


48 ( 1 .9) 


221 ( 1.7)> 


1 75 ( 4.8)> 


200 ( 2.8)> 


223 ( 2.2)> 


247 ( 2.0)> 


265 ( 2.9) 


Nation 


50 ( 0.7) 


212 ( 1.2)> 


161 ( 2.8)> 


188 ( 1.3)> 


215 ( 1.1) 


240 ( 1 .9) 


259 ( 1 .4) 


1994 Massachusetts 


50 ( 0.9) 


221 ( 1.5) 


175(2.9) 


199 ( 1.6) 


224 ( 3.0) 


244 ( 1 .4) 


262 ( 2.5) 


Northeast 


50 { 1.1) 


207 ( 3.0) 


148 ( 6.7) 


181 ( 3.8) 


211 (2.9) 


238 ( 2.6) 


258 ( 5.3) 


Nation 


51 ( 0.7) 


207 ( 1 .3) 


149 ( 1.8) 


181 ( 1.0) 


211 ( 1.8) 


237 ( 1 .2) 


257 ( 1.9) 


1992 Massachusetts 


50 ( 0.9) 


225 ( 1 .2) 


188(2.2) 


206 ( 1.8) 


227 ( 2.0) 


245 ( 0.9) 


261 ( 1.4) 


Northeast 


50 { 2.0) 


217 ( 4.6) 


171 ( 7.6) 


193 ( 5.1) 


218 ( 5.5) 


243 ( 4.6) 


263 ( 7.0) 


Nation 


51 ( 0.7) 


211 ( 1.3) 


163 ( 2.1) 


188 ( 1.9) 


213 ( 1.4) 


237 ( 2.0) 


256 ( 2.4) 


Grade 8 
















1998 Massachusetts 


51 ( 1.3) 


263 ( 1.9) 


224 ( 4.5) 


244 ( 1.9) 


265 ( 1.7) 


285 ( 1 .6) 


302 ( 3.4) 


Northeast 


51 ( 1.5) 


261 ( 1.5) 


217(4.0) 


241 ( 2.5) 


265 ( 2.3) 


286 ( 1.7) 


302 ( 1.2) 


Nation 


51 ( 0.5) 


255 ( 1 .0) 


207 ( 2.4) 


232 ( 1.7) 


257 ( 1 .0) 


280 ( 0.9) 


297 ( 1.3) 


Females 
Grade 4 
















1998 Massachusetts 


52 ( 1 .0) 


229 ( 1.7) 


187 (2.2) 


209 ( 2.3) 


232 ( 2.1) 


252 ( 1.7) 


269 ( 1.7) 


Northeast 


52 ( 1 .9) 


228 ( 2.0)> 


184 ( 3.2)> 


205 ( 2.9)> 


230 ( 2.2)> 


253 ( 2.0)> 


270 ( 3.6) 


Nation 


50 ( 0.7) 


218 ( 0.8) 


170 ( 1.7) 


195 ( 1.5) 


221 ( 1 .0) 


244 ( 1.2) 


263 ( 1.1) 


1994 Massachusetts 


50 (0.9) 


226 ( 1.5) 


179 ( 2.5) 


204 ( 2.3) 


229 ( 1.7) 


250 ( 1.9) 


267 ( 2.5) 


Northeast 


50 ( 1.1) 


216 ( 2.2) 


160 ( 3.1) 


192 ( 4.1) 


220 ( 3.7) 


245 ( 2.2) 


263 ( 2.6) 


Nation 


49 ( 0.7) 


218 ( 1.2) 


165 ( 1.6) 


194(2.0) 


222 ( 2.3) 


245 ( 1 .4) 


264 ( 2.1) 


1992 Massachusetts 


50 ( 0.9) 


227 ( 1.1) 


188 ( 2.8) 


208 ( 2.2) 


229 ( 1 .4) 


248 ( 1 .3) 


264 ( 2.5) 


Northeast 


50 ( 2.0) 


223 ( 3.6) 


177 ( 6.9) 


200 ( 3.5) 


226 ( 3.9) 


247 ( 3.8) 


268 ( 8.4) 


Nation 


49 ( 0.7) 


219 ( 1.1) 


173 ( 2.1) 


197 ( 2.0) 


221 ( 1.1) 


243 ( 1.6) 


262 ( 1.7) 


Grade 8 
















1998 Massachusetts 


49 ( 1 .3) 


274 ( 1 .7) 


233 ( 3.1) 


255 ( 1.9) 


276 ( 1.9) 


296 ( 1.8) 


312 ( 1.9) 


Northeast 


49 { 1 .5) 


273 ( 2.4) 


229 (4.1) 


253 ( 2.9) 


275 ( 2.7) 


296 ( 2.2) 


315 ( 5.2) 


Nation 


49 ( 0.5) 


268 ( 1 .0) 


225 ( 1 .6) 


248 ( 1.1) 


271 ( 1.2) 


291 ( 1.4) 


308 ( 1.5) 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics in the table appear in parentheses. 
If the notation >(<) appears, it signifies that the 1998 value was significantly higher (lower) than the value for 1994 at 
about the 95 percent confidence level. If the notation »(«) appears, it signifies that the 1998 value was significantly higher 
(lower) than the value for 1992 at about the 95 percent confidence level. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992, 1994, 
and 1998 Reading Assessments. 
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Achievement Level Results by Gender 

As shown in Table 2B, the following is true of achievement levels attained by 

Massachusetts’ public school students. 

Public School Students, Grade 4 

• In 1998, 31 percent of males and 42 percent of females performed at or above the 
Proficient level in Massachusetts. These percentages were significantly different. 

• The percentage of males in Massachusetts who were at or above the Proficient level 
in 1998 (31 percent) was not significantly different from that of males in the nation 
(27 percent). 

• The percentage of females in Massachusetts at or above this level in 1998 
(42 percent) was greater than that of the nation’s females (31 percent). 

• The percentages of both males and females performing at or above the Proficient 
level were not significantly different in 1998 from those in 1992. 

• The percentages of both males and females performing at or above the Proficient 
level were not significantly different in 1998 from those in 1994. 

Public School Students, Grade 8 

• In 1998, 29 percent of males and 44 percent of females in Massachusetts performed 
at or above the Proficient level. These percentages were significantly different. 

• In 1998, the percentage of males at or above the Proficient level in Massachusetts 
(29 percent) was not significantly different from that of males in the nation 

(24 percent). 

• The percentage of females in Massachusetts performing at or above the Proficient 
level in 1998 (44 percent) was greater than that of females nationwide (37 percent). 
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TABLE 2B 


REPORT 

CARD 

1998 


rcaep 


Percentages of public school students attaining achievement levels 
by gender: 1992 to 1998 


State Assessment 



Below Basic 



At or Above 
Basic 



i 

| At or Above 
| Proficient 



Advanced 



Males 










Grade 4 










1998 Massachusetts 


30 ( 2.2) 


70 ( 2.2) 


31 ( 2.2) 


5(1.1) 


Northeast 


33 ( 2.2)< 


67 ( 2.2)> 


34 ( 2.3) 


8(1.5) 


Nation 


43 ( 1.5) 


57 ( 1.5) 


27 ( 1.3) 


6 ( 0.7) 


1994 Massachusetts 


33 ( 1.8) 


67 ( 1.8) 


33 ( 2.1) 


7(14) 


Northeast 


47 ( 2.9) 


53 ( 2.9) 


25 ( 3.4) 


7(2.1) 


Nation 


47 ( 1.5) 


53 { 1.5) 


24 ( 1.3) 


6 ( 0.8) 


1992 Massachusetts 


27(1.4) 


73(1.4) 


34 ( 2.3) 


5(0.7) 


Northeast 


39 ( 5.0) 


61 ( 5.0) 


30 ( 5.7) 


8 ( 3.0) 


Nation 


44 ( 1.7) 


56 ( 1.7) 


24 ( 1.5) 


5 ( 0.7) 


Grade 8 








2 ( 0.6) 


1998 Massachusetts 


24 ( 2.2) 


76 ( 2.2) 


29 ( 2.4) 


Northeast 


27 { 1.7) 


73(1.7) 


31 (14) 


i m 


Nation 


35 { 1.2) 


65 ( 1.2) 


24 ( 1.0) 


1 ( 0.3) 


Females 
Grade 4 










1 998 Massachusetts 


24 ( 1.9) 


76 ( 1.9) 


42 ( 2.4) 


10(1.1) 


Northeast 


28 ( 2.2)< 


72 ( 2.2)> 


41 (3.0) 


11 ( 2.0) 


Nation 


36(1.1) 


64 ( 1.1) 


31 (1.1) 


7 ( 0.6) 


1994 Massachusetts 


28 ( 1 .8) 


72 ( 1 .8) 


39 ( 2.1) 


9(1.5) 


Northeast 


37 ( 3.0) 


63 ( 3.0) 


31 ( 2.6) 


7(1.8) 


Nation 


36 ( 1.3) 


64 ( 1.3) 


32 (1.6) 


8 ( 0.9) 


1992 Massachusetts 


25 ( 1 .8) 


75 ( 1.8) 


38 ( 1 .6) 


8(1.2) 


Northeast 


32 ( 4.2) 


68 ( 4.2) 


35 ( 4.6) 


10 ( 3.0) 


Nation 


35 ( 1.5) 


65 ( 1.5) 


30 ( 1.5) 


7 ( 0.9) 


Grade 8 










1998 Massachusetts 


15 ( 1.5) 


85 ( 1.5) 


44 ( 2.5) 


4 ( 1-1) 


Northeast 


17 ( 1.6) 


83 ( 1.6) 


43 ( 3.1) 


5 ( 2.0) 


Nation 


21 ( 0.9) 


79 ( 0.9) 


37 ( 1.3) 


3 ( 0.6) 



The achievement levels correspond to the following points on the NAEP reading scale at grade 4 (and 8): Basic , 208-237 
(243-280); Proficient , 238-267 (281-322); and Advanced 268 (323) and above. The standard errors of the statistics in 
the table appear in parentheses. If the notation >(<) appears, it signifies that the 1998 value was significantly higher 
(lower) than the value for 1994 at about the 95 percent confidence level. If the notation »(«) appears, it signifies that the 
1998 value was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
**** Standard error estimates cannot be accurately determined. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992, 1994, 
and 1998 Reading Assessments. 
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Race/Ethnicity 

As part of the background questionnaire administered with the assessment, students were 
asked to identify the racial/ethnic subgroup that best described them. The five mutually 
exclusive categories were White, Black, Hispanic, Asian/Pacific Islander, and American 
Indian. This information was the primary contributor to the classifications appearing 
below. For details of the derivation of this variable, see the NAEP 1998 Reading Report 
Card. 

For 1994, the category termed Asian/Pacific Islander in 1992 and 1998 was split 
into two components. In jurisdictions with small populations of either of these minority 
groups, there was an increased likelihood that separate results were not reported for 
1994. Even though this switch changed the format of the question in 1994, the values 
for the race/ethnicity groups appear unaffected. Consequently, 1994 results for Asian 
and Pacific Islander students have been combined for this report. See the forthcoming 
NAEP 1998 Technical Report for more information on the comparability of these results 
to results for 1992 and 1998. 

Table 3A shows scale scores for public school students by racial and ethnic 
background in Massachusetts, the Northeast region, and the nation. Only the 
race/ethnicity categories with sufficient membership to meet reporting requirements in 
Massachusetts are reported. 

Scale Score Results by Race/Ethnicity 

In terms of average reading scale scores for Massachusetts’ public school students, 

Table 3A indicates the following. 

Public School Students, Grade 4 

• In 1998, White students in Massachusetts had an average scale score that was higher 
than those of Black, Hispanic, and Asian/Pacific Islander students. 

• The average scale score of White, Black, Hispanic, and Asian/Pacific Islander 
students in Massachusetts did not differ significantly in 1998 from in 1992. 

• The average scale score of White, Black, Hispanic, and Asian/Pacific Islander 
students in Massachusetts did not differ significantly in 1998 from in 1994. 

Public School Students, Grade 8 

• In 1998, White students in Massachusetts had an average scale score that was higher 
than those of Black and Hispanic students but was not significantly different from 
that of Asian/Pacific Islander students. 
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REPORT 

CARD 
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-4 




Average reading scale scores and selected percentiles for public 
school students by race/ethnicity: 1992 to 1998 


State Assessment 




Percentage 
of total 
population 


Average 

scale 

score 




Scale score distribution 




10th 

percentile 


25th 50th 75th 

percentile percentile percentile 


90th 

percentile 



White 








Grade 4 








1998 Massachusetts 


78(1.7) 


231 ( 1.3) 


195 ( 2.2) 


Northeast 


69 ( 2.5) 


234 ( 1 4)> 


194(4.2) 


Nation 


66 ( 0.6)« 


225 ( 0.9) 


181 ( 3.2) 


1994 Massachusetts 


77(1.6) 


231 ( 1.2) 


191 (2.5) 


Northeast 


62 ( 2.4) 


224 ( 2.5) 


180(7.9) 


Nation 


68 ( 0.5) 


223 ( 1.3) 


175 ( 2.3) 


1992 Massachusetts 


81 ( 1.2) 


231 ( 0.9) 


194 ( 1.6) 


Northeast 


68 ( 3.4) 


229 ( 3.9) 


187(6.6) 


Nation 


69 ( 0.5) 


223 ( 1.3) 


180(2.3) 


Grade 8 








1998 Massachusetts 


76 ( 1.5) 


274 ( 1.5) 


237 ( 2.2) 


Northeast 


72 ( 2.6) 


275 ( 1.8) 


234 ( 3.1) 


Nation 


66 ( 0.5) 


270 ( 0.9) 


228 ( 2.3) 


Black 








Grade 4 








1998 Massachusetts 


7 ( 0.8) 


202 ( 3.2) 


163 ( 7.8) 


Northeast 


18 ( 2.0) 


202 ( 2.5)> 


159 ( 7.4) 


Nation 


16 ( 0.4) 


193 ( 18)> 


145 ( 5.1) 


1994 Massachusetts 


7( 1.0) 


199 ( 3.1) 


155 ( 5.2) 


Northeast 


22 ( 2.5) 


184 ( 2.1) 


133(4.7) 


Nation 


16 ( 0.4) 


186 ( 1.7) 


135 ( 3.1) 


1992 Massachusetts 


7 ( 0.6) 


205 ( 2.7) 


170 ( 3.5) 


Northeast 


20 ( 3.2) 


197 ( 3.8) 


157 ( 5.2) 


Nation 


17 ( 0.4) 


192 ( 1.6) 


148 ( 3.5) 


Grade 8 








1998 Massachusetts 


7 (1-1) 


251 ( 3.4) 


215 ( 3.8) 


Northeast 


16 ( 2.0) 


244 ( 3.4) 


202 ( 7.1) 


Nation 


15 ( 0.3) 


241 ( 1.6) 


200 ( 2.2) 


Hispanic 








Grade 4 








1998 Massachusetts 


10 ( 1.3) 


200 ( 3.3) 


157 ( 4.2) 


Northeast 


9(1.0) 


203 ( 2.9)> 


158 ( 5.8) 


Nation 


14 ( 0.5)>» 


195 ( 1.9) 


145 ( 2.7) 


1994 Massachusetts 


1 1 ( 0.8) 


194 ( 2.8) 


146 ( 4.6) 


Northeast 


10 ( 1.4) 


191 (4.2) 


135 ( 9.1) 


Nation 


12 ( 0.3) 


188(2.7) 


134(4.7) 


1992 Massachusetts 


7 ( 0.6) 


201 ( 2.2) 


164 ( 5.5) 


Northeast 


9(1.3) 


200 ( 4.9) 


151 (12.0) 


Nation 


10 ( 0.3) 


199(2.2) 


151 ( 4.2) 


Grade 8 








1998 Massachusetts 


11 ( 1.2) 


246 ( 3.3) 


205 ( 7.0) 


Northeast 


8(1.1) 


244 ( 5.3) 


196(17.8) 


Nation 


14 ( 0.3) 


243( 2.1) 


195 ( 6.4) 



214 ( 


:i.i) 


233 ( 1.4) 


251 { 


[1.2) 


267 ( 


I 1-9) 


214 < 


: 3.o) 


236 ( 2.1) 


256 < 


[ 1.7) 


272 ( 


: 3.6) 


204 < 


: i-7) 


228 ( 0.8) 


249 1 


[ 1.2) 


266 ( 


I 1-2) 


212 < 


: 2 . 3 ) 


232 ( 0.9) 


252 < 


[ 1.5) 


268 < 


[1.3) 


204 { 


: 2 . 5 ) 


228 ( 2.6) 


248 l 


(2.6) 


267 < 


[2.5) 


201 { 


[1.7) 


226 ( 1.4) 


247 1 


(1.1) 


266 < 


[2.4) 


213 j 


[1.2) 


232 ( 1.8) 


250 1 


(2.1) 


265 < 


[ 1.3) 


208 1 


[2.4) 


230 ( 3.9) 


252 l 


(4.7) 


271 { 


[6.7) 


202 < 


[1.4) 


225 ( 1 .6) 


246 1 


( 1-3) 


264 l 


(1.6) 


256 1 


(2.3) 


275 ( 1.8) 


294 i 


(1.4) 


310 1 


( 1-7) 


256 1 


(1.8) 


278 ( 1.8) 


296 i 


(1.5) 


311 1 


(2.0) 


250 1 


(0.9) 


272 ( 1.2) 


291 i 


(0.9) 


308 l 


( 1-3) 



182 { 


[6.9) 


203 ( 3.0) 


224 ( 


! 2.6) 


240 ( 


(7.8) 


181 l 


( 2.7)> 


202 ( 4.6)> 


224 < 


[2.1)> 


244 { 


(4.2) 


170 l 


(5.0) 


195 ( 2.0) 


218 \ 


(2.2) 


237 < 


[ 1-8) 


177 1 


(6.3) 


199 ( 3.2) 


222 { 


(5.1) 


243 \ 


(2.1) 


160 l 


(1.5) 


185(2.3) 


210 { 


[3.1) 


234 { 


(2.9) 


160 l 


(19) 


187 ( 1.9) 


213 < 


[2.2) 


234 < 


[2.3) 


187 1 


(4.3) 


207 ( 3.0) 


223 \ 


[4.2) 


238 1 


(4.9) 


175 l 


(8.3) 


198(6.4) 


220 \ 


[5.4) 


239 1 


(3.6) 


169 i 


(3.0) 


193 ( 2.0) 


215 1 


(2.6) 


235 1 


(2.2) 


231 i 


(4.4) 


248 ( 3.1) 


269 1 


(9.9) 


292 (15.6) 


224 i 


(5.7) 


247 ( 2.8) 


267 1 


(3.4) 


284 l 


(5.1) 


220 


(1.8) 


243 ( 2.0) 


265 1 


(2.2) 


283 1 


(1.7) 



177 1 


(4.6) 


199 (3.5) 


224 < 


(6.4) 


CO 

'T 

CM 


[5.2) 


183 i 


(5.0) 


205 ( 5.7) 


227 < 


[3.6) 


244 { 


[5.9) 


170 1 


(3.0) 


196 ( 2.2) 


222 { 


[2.0) 


242 { 


[2.4) 


169 I 


(8.7) 


196 ( 2.6) 


220 { 


[4.5) 


239 1 


( 4.2) 


162 1 


(9.2) 


194 ( 4.7) 


223 \ 


[5.1) 


244 { 


[8.8) 


160 l 


(3.5) 


189 (4.2) 


217 { 


[3.5) 


242 1 


[3.6) 


181 1 


(8.5) 


201 ( 3.1) 


222 < 


(3.3) 


239 1 


(6.6) 


176 1 


(7.6) 


201 ( 5.7) 


227 { 


[5.1) 


246 1 


(7.2) 


175 i 


(2.4) 


200 ( 3.7) 


225 l 


(3.9) 


245 l 


(2.4) 


225 i 


(4.1) 


247 ( 5.2) 


268 1 


(4.6) 


290 l 


(5.4) 


224 1 


(9.6) 


245 ( 4.4) 


267 1 


(4.3) 


289 (15.3) 


221 i 


(3.9) 


245 ( 2.7) 


268 1 


( 1-5) 


286 ( 2.0) 



(continued on next page) 
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TABLE 3A (continued) 


Average reading scale scores and selected percentiles for public 
school students by race/ethnicity: 1992 to 1998 


State Assessment 





Percentage 


Average 




Scale score distribution 








of total 
population 


scale 

score 


10th 

percentile 


25th 

percentile 


50th 

percentile 


75th 

percentile 


90th 

percentile 


Asian/Pacific Islander 
Grade 4 

1998 Massachusetts 


4 { 0.7) 


216 ( 5.5) 


171 ( 9.6) 


194 ( 7.5) 


215 ( 8.7) 


241 ( 6.3) 


263 ( 7.8) 


Northeast 


2 { 0.4) 


*** <*V) 


*** <*V) 


*** <*V) 


*** <*V) 


*** cv 


) 


*** (*V) 


Nation 


2 { 0.2) 


222 ( 2.8) 


175 ( 8.8) 


199 ( 3.4) 


223 ( 5.7) 


248 ( 6.7) 


269 ( 5.6) 


1994* Massachusetts 


3 ( 0.6) 


202 ( 8.9)! 


154 (18.4)1 


175 (17.1)1 


204 (10.8)1 


228 (15.2)1 


250 (18.3)1 


Northeast 


3 ( 0.9) 


*** <*V) 


*** <*V) 


*** <*V) 


*** <*V) 


*** <*V 


) 


*** (**.*) 


Nation 


3 ( 0.3) 


227 ( 4.9) 


173 ( 9.7) 


206 ( 6.9) 


232 ( 5.3) 


254 ( 5.9) 


272 ( 7.5) 


1992 Massachusetts 


3 ( 0.7) 


218 ( 6.4)1 


179 (15.7)1 


197 ( 5.0)1 


219 (11.1)1 


239 ( 7.1)! 


262 (12.0)1 


Northeast 


2 ( 0.5) 


*** r .*) 


*** <*V) 


*** (*V) 


*** (**.*) 


*** rv 


) 


*** (*V) 


Nation 


2 ( 0.3) 


214 { 3.6) 


173 (10.2) 


192 ( 5.7) 


215(4.7) 


237 ( 4.4) 


253 ( 8.5) 


Grade 8 

1998 Massachusetts 


5 ( 0.8) 


267 ( 5.7) 


222 ( 7.9) 


245(10.8) 


272 ( 4.7) 


293 ( 7.1) 


309 (10.8) 


Northeast 


2 { 0.5) 


271 { 4.6) 


239 ( 5.4) 


253 (13.4) 


272 ( 5.0) 


289 ( 6.2) 


304 (32.2) 


Nation 


4 ( 0.3) 


269 ( 4.0) 


228 ( 4.3) 


250 ( 5.4) 


272 ( 4.4) 


291 ( 5.4) 


308 ( 4.1) 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. If the notation 
>(<) appears, it signifies that the 1998 value was significantly higher (lower) than the value for 1994 at about the 95 
percent confidence level. If the notation »(«) appears, it signifies that the 1998 value was significantly higher (lower) than 
the value for 1992 at about the 95 percent confidence level. * In 1994, this category was split into two. Examination 
of the data for all race/ethnicity groups for all years shows that this split had no effect. Consequently, the two categories 
are combined for this report. ! Interpret with caution — the nature of the sample does not allow accurate determination 
of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992, 1994, 
and 1998 Reading Assessments. 
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Achievement Level Results by Race/Ethnicity 

Table 3B shows the following to be true of achievement levels attained by 

Massachusetts’ public school students. 

Public School Students, Grade 4 

• In Massachusetts in 1998, the percentage of White students performing at or above 
the Proficient level was greater than those of Black, Hispanic, and Asian/Pacific 
Islander students. 

• The respective percentages of White, Black, Hispanic, and Asian/Pacific Islander 
students in Massachusetts performing at or above the Proficient level did not differ 
significantly in 1998 from those in 1992. 

• The respective percentages of White, Black, Hispanic, and Asian/Pacific Islander 
students in Massachusetts performing at or above the Proficient level did not differ 
significantly in 1998 from those in 1994. 

Public School Students, Grade 8 

• In Massachusetts, the percentage of White students performing at or above the 
Proficient level in 1998 was greater than those of Black and Hispanic students but 
was not significantly different from that of Asian/Pacific Islander students. 
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TABLE 3B 


Percentages of public school students attaining achievement levels 
by race/ethnicity: 1992 to 1998 


State Assessment 



Below Basic 



\ At or Above 
Basic 



At or Above 

Proficient Advanced 



White 












Grade 4 










1998 


Massachusetts 


19 { 1.5) 


81 ( 1.5) 


43 { 2.3) 


9 ( 1.2) 




Northeast 


20 ( 2.0) 


80 ( 2.0) 


47 ( 2.2) 


13 { 1.6) 




Nation 


28 { 1.2) 


72 ( 1.2) 


38 ( 1.2) 


9 { 0.7) 


1994 


Massachusetts 


22 { 1 .3) 


78 ( 1.3) 


42 ( 1.9) 


10 { 1.3) 




Northeast 


28 { 3.3) 


72 { 3.3) 


37 ( 3.3) 


9(18) 




Nation 


31 { 1.3) 


69 ( 1.3) 


35 ( 1.5) 


9 { 0.9) 


1992 


Massachusetts 


20 ( 1.1) 


80 ( 1.1) 


41 (1.7) 


8 { 0.9) 




Northeast 


25 ( 3.6) 


75 ( 3.6) 


41 ( 5.4) 


12 { 3.4) 




Nation 


30 { 1.5) 


70 ( 1.5) 


33 ( 1.9) 


8{ 1.0) 


Grade 8 










1998 


Massachusetts 


14 { 1.2) 


86 ( 1.2) 


41 ( 2.4) 


3 ( 0.8) 




Northeast 


15 { 1.4) 


85 ( 1.4) 


45 ( 2.3) 


4{ 1.7) 




Nation 


19 { 0.9) 


81 { 0.9) 


38 ( 1.2) 


3 ( 0.6) 


Black 












Grade 4 












1998 


Massachusetts 


56 { 4.6) 


44 { 4.6) 


12 ( 4.0) 


1 (****) 




Northeast 


57 { 4.0)< 


43 { 4.0)> 


13 { 2.5) 


2(1.2) 




Nation 


65 { 1.9) 


35 ( 1.9) 


9(1.0) 


1 ( 0.5) 


1994 


Massachusetts 


61 { 4.0) 


39 { 4.0) 


13 ( 2.3) 


2 C”) 




Northeast 


73 ( 2.7) 


27 { 2.7) 


7(1.7) 


i r**> 




Nation 


70 ( 2.5) 


30 { 2.5) 


8 { 0.9) 


1 ( 0.4) 


1992 


Massachusetts 


52 { 4.4) 


48 { 4.4) 


10 ( 3.2) 


1 ( 0.7) 




Northeast 


63 { 4.7) 


37 ( 4.7) 


11 (3.1) 


i m 




Nation 


68 { 2.1) 


32 ( 2.1) 


8 ( 1.4) 


i 


Grade 8 












1998 


Massachusetts 


42 ( 6.4) 


58 ( 6.4) 


15 ( 4.0) 


2 ( 1.4) 




Northeast 


44 { 4.1) 


56 { 4.1) 


12 ( 2.9) 


o rn 




Nation 


50 ( 2.5) 


50 ( 2.5) 


11 ( 1.3) 


o cn 


Hispanic 










Grade 4 












1998 


Massachusetts 


59 ( 4.2) 


41 ( 4.2) 


14 { 3.2) 


i r~) 




Northeast 


52 { 5.4) 


48 { 5.4) 


14 { 2.8) 


i r~> 




Nation 


62 { 2.0) 


38 ( 2.0) 


12 ( 1.3) 


2 ( 0.4) 


1994 


Massachusetts 


63 { 4.0) 


37 ( 4.0) 


10 { 2.1) 


i m 




Northeast 


63 ( 4.9) 


37 ( 4.9) 


12 { 3.6) 


2 rn 




Nation 


67 { 2.6) 


33 ( 2.6) 


12 { 1.6) 


2 { 0.7) 


1992 


Massachusetts 


58 ( 4.3) 


42 ( 4.3) 


11 (2.5) 


i m 




Northeast 


57 ( 5.8) 


43 ( 5.8) 


15 ( 5.5) 


i rn 




Nation 


58(2.1) 


42 (2.1) 


14 { 1.8) 


2 ( 10) 


Grade 8 












1998 


Massachusetts 


45 ( 4.5) 


55 ( 4.5) 


15 ( 3.1) 


i rn 




Northeast 


46 { 7.5) 


54 ( 7.5) 


15 ( 3.7) 


i rn 




Nation 


48 { 2.5) 


52 ( 2.5) 


14 { 1.3) 


0 ( 0.2) 



{continued on next page) 
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waep 

iessmen 


Percentages of public school students attaining achievement levels 
by race/ethnicity: 1992 to 1998 


Below Basic ! 


I 


At or Above 

Basic M or Above 

Proficient Advanced 



Asian/Pacific Islander 
Grade 4 

1998 Massachusetts 


43(7.4) 


57 ( 7.4) 


26(6.1) 


9 ( 5.5) 


Northeast 


*** (*V) 


<*V) 


... ( .. .) 


... (.. .) 


Nation 


34 ( 4.8) 


66 ( 4.8) 


34 ( 4.4) 


10 (3.2) 


1994* Massachusetts 


56 ( 9.6)! 


44 ( 9.6)! 


17(6.3)! 


4 (****)! 


Northeast 


*** <*V) 


<*V) 


... (.. .) 


... (.. .) 


Nation 


26 ( 4.5) 


74 ( 4.5) 


42 ( 6.0) 


12 ( 5.7) 


1992 Massachusetts 


38 ( 9.4)! 


62 ( 9.4)! 


27 (10.2)1 


5 <****)! 


Northeast 


*** <*V) 


(*V) 


... (.. .) 


... (.. .) 


Nation 


41 ( 5.2) 


59 ( 5.2) 


24 ( 5.0) 


4(2.1) 


Grade 8 

1998 Massachusetts 


23 ( 5.6) 


77 ( 5.6) 


38 ( 7.2) 


4 rn 


Northeast 


15 ( 5.0) 


85 ( 5.0) 


35 ( 6.9) 


3 r**) 


Nation 


20 ( 4.9) 


80 ( 4.9) 


36 ( 5.3) 


3 ( 1.2) 



The achievement levels correspond to the following points on the NAEP reading scale at grade 4 (and 8): Basic, 208-237 
(243-280); Proficient, 238-267 (281-322); and Advanced , 268 (323) and above. The standard errors of the statistics appear 
in parentheses. If the notation >(<) appears, it signifies that the 1998 value was significantly higher (lower) than the value 
for 1994 at about the 95 percent confidence level. If the notation »(«) appears, it signifies that the 1998 value was 
significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. * In 1994, this category 
was split into two. Examination of the data for all race/ethnicity groups for all years shows that this split had no effect. 
Consequently, the two categories are combined for this report. ! Interpret with caution — the nature of the sample does 
not allow accurate determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable 
estimate. **** Standard error estimates cannot be accurately determined. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992, 1994, 
and 1998 Reading Assessments. 
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Students’ Reports of Parents’ Highest Education Level 

As part of the background questionnaire administered with the assessment, students were 
asked to identify the highest level of education completed by each parent. The groupings 
were determined by the highest educational level reported for either parent. 

Level of parental education has always exhibited the same general pattern in 
NAEP reports: the higher the level of parental education, the higher the level of student 
performance. This finding is borne out by other studies; for instance, see a paper by 
Grissmer, Kirby, Berends, and Williamson (1994) that includes findings from the 
National Longitudinal Survey of Youth (NLSY) and the National Education 
Longitudinal Study (NELS). 8 

Table 4A shows scale scores for public school students by parents’ highest 
education level in Massachusetts, the Northeast region, and the nation. Because the 
format for the question was changed for grade 4, only grade 8 results are reported. The 
format change is described in the NAEP 1998 Reading Report Card. 

Scale Score Results by Parents’ Education 

In terms of average reading scale scores for Massachusetts’ eighth-grade public school 
students in 1998, Table 4A indicates the following. (Note that the following discussion 
pertains only to those students who reported knowing the highest level of education 
achieved by one or both parents.) 

Public School Students , Grade 8 

• Students in Massachusetts who affirmed that neither parent graduated from high 
school had an average reading scale score that was lower than those of students 
reporting that at least one parent graduated from high school, at least one parent had 
some education after high school, or at least one parent graduated from college. 

• The average scale score for students reporting that at least one parent graduated from 
college in Massachusetts was higher than that of similar students nationwide. The 
average scale score for students reporting that neither parent graduated from high 
school, at least one parent graduated from high school, or at least one parent had 
some education after high school in Massachusetts was not significantly different 
from that of similar students nationwide. 
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8 

Grissmer, D. W., Kirby, S. N., Berends, M., and Williamson, S. (1994). Student achievement and the changing American 
family (Publication No. MR-488-LE). Santa Monica, CA: RAND. 
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TABLE 4A 


Average reading scale scores and selected percentiles for public 
school students by parents’ highest level of education: 1998 


State Assessment 



Percentage 


Average 




Scale score distribution 




of total 


scale 


10th 




25th 


50th 


75th 


90th 


population 


score 


percentile 


percentile 


percentile 


percentile 


percentile 



Did not finish 
high school 
Grade 8 

1998 Massachusetts 


6 


0.6) 


242 


4.3) 


197 ( 9.9) 


220 | 


(6.8) 


244 1 


(5.3) 


266 l 


(5.8) 


282 ( 4.4) 


Northeast 


5 


0.6) 


245 


4.8) 


198 (29.4) 


225 1 


(5.1) 


248 1 


(2.6) 


268 | 


(4.2) 


282 (16.1) 


Nation 


8 l 


(0.4) 


242 | 


( 1-9) 


200 < 


[ 1.9) 


221 | 


(4.0) 


244 1 


(3.4) 


266 | 


(3.4) 


283 | 


(2.7) 


Graduated from 
high school 
Grade 8 

1998 Massachusetts 


19 l 


( 1.0) 


256 1 


(2.1) 


218 < 


(4.8) 


237 I 


( 18) 


257 1 


(2.9) 


276 1 


(2.2) 


293 1 


(3.8) 


Northeast 


21 1 


( 13) 


256 1 


(2.2) 


214 1 


(5.7) 


234 | 


(6.4) 


256 1 


(1.3) 


279 1 


(3.3) 


297 l 


(2.6) 


Nation 


23 l 


(0.6) 


253 1 


( 13) 


209 1 


(3.2) 


231 1 


(2.5) 


255 < 


(17) 


277 1 


( 1.4) 


294 1 


(3.3) 


Some education 
after high school 
Grade 8 

1998 Massachusetts 


16 1 


( 1.0) 


273 | 


(2.4) 


240 | 


(3.1) 


256 { 


(2.4) 


274 1 


(2.9) 


292 | 


(2.6) 


307 1 


(1.7) 


Northeast 


15 1 


( 1.5) 


271 1 


(2.6) 


230 ( 


(3.5) 


253 i 


(3.8) 


275 | 


(3.3) 


291 1 


(5.9) 


308 1 


(3.8) 


Nation 


18 1 


(0.5) 


268 | 


( 1-4) 


227 ( 


(3.2) 


249 1 


( 15) 


270 1 


( 1.9) 


288 ( 


( 1.4) 


306 1 


(2.1) 


Graduated from 
college 
Grade 8 

1998 Massachusetts 


50 | 


( 1.6) 


278 | 


( 1-7) 


241 \ 


(3.1) 


261 { 


( 1.8) 


279 1 


(2.1) 


298 1 


( 1.6) 


313 1 


(3.3) 


Northeast 


51 1 


(2.3) 


277 1 


(2.0) 


238 { 


(2.2) 


258 l 


(2.9) 


279 1 


(1.8) 


298 1 


[2.8) 


314 1 


(4.6) 


Nation 


42 | 


(0.9) 


272 | 


( 1-0) 


229 { 


( 1.7) 


252 1 


(0.9) 


275 1 


(1.0) 


294 1 


( 13) 


311 1 


( 1-8) 


/ don ’f know. 

Grade 8 

1998 Massachusetts 


8 1 


(0.8) 


253 1 


(3.6) 


214 ( 


(4.1) 


230 | 


(7.4) 


253 | 


(7.1) 


276 { 


(5.1) 


295 { 


(7.7) 


Northeast 


8 1 


(0.7) 


243 | 


(3.0) 


199 1 


(5.4) 


224 l 


(7.4) 


245 1 


(2.9) 


267 ( 


(2.7) 


284 | 


(3.6) 


Nation 


10 1 


(0.4) 


241 { 


(2.0) 


195 { 


(2.2) 


219 1 


(2.7) 


242 | 


(0.9) 


266 | 


(2.4) 


283 | 


( 16) 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics in the table appear in parentheses. 
SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1998 Reading 
Assessment. 
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Achievement Level Results by Parents’ Education 

In terms of achievement levels attained by Massachusetts’ eighth-grade public school 
students in 1998, Table 4B shows the following. (As with the previous discussion 
regarding average scale scores, the following pertains only to those students who 
reported knowing the highest level of education achieved by at least one parent.) 

Public School Students Grade 8 

• The percentage of students in Massachusetts reporting that neither parent graduated 
from high school who performed at or above the Proficient level was not 
significantly different from the corresponding percentage for students reporting that 
at least one parent graduated from high school but was smaller than those of students 
reporting that at least one parent had some education after high school or that at least 
one parent graduated from college. 

• For students reporting all four levels of parental education, the percentage who 
performed at or above the Proficient level did not differ significantly in 
Massachusetts from that nationwide. 
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TABLE 4B 


ffvaep 



essmen 


Percentages of public school students attaining achievement levels 
by parents’ highest level of education: 1998 


Below Basic 




At or Above 

| Basic At or Above 

I Proficient Advanced ^ 




Did not finish high school 
Grade 8 
















1998 Massachusetts 


49 i 


(5.0) 


51 i 


(5.0) 


12 i 


(3.8) 


o 


Northeast 


43 1 


(6.5) 


57 i 


(6.5) 


11 i 


(4.2) 


o m 


Nation 


49 1 


(2.5) 


51 1 


(2.5) 


11 1 


( 1-5) 


o 


Graduated from high school 
Grade 8 
















1 998 Massachusetts 


31 1 


(2.5) 


69 l 


(2.5) 


20 l 


(2.8) 


1 ( 0.5) 


Northeast 


33 1 


(4.2) 


67 l 


(4.2) 


23 1 


(2.5) 


i r**> 


Nation 


36 1 


(2.1) 


64 l 


(2.1) 


21 1 


(13) 


1 ( 0.4) 


Some education after HS 
Grade 8 
















1998 Massachusetts 


12| 


(2.2) 


88 l 


(2.2) 


39 1 


(4.3) 


2(1.1) 


Northeast 


18| 


(2.3) 


82 l 


(2.3) 


41 1 


(5.5) 


3 


Nation 


20 I 


(1.6) 


80 l 


(1.6) 


35 1 


(2.1) 


2 ( 0.7) 


Graduated from college 
Grade 8 
















1 998 Massachusetts 


11 1 


: i.5) 


89 1 


(1.5) 


48 1 


(3.0) 


5(1.1) 


Northeast 


131 


: i.2) 


87 1 


(1.2) 


48 1 


(2.5) 


5(1.8) 


Nation 


18 1 


: i.o) 


82 1 


(1.0) 


42 1 


(1-5) 


4 ( 0.7) 


/ don’t know. 
Grade 8 
















1 998 Massachusetts 


37 1 


(5.9) 


63 1 


(5.9) 


181 


(4.0) 


i r**> 


Northeast 


48 1 


: 5.3) 


52 1 


(5.3) 


11 1 


(2.8) 


o 


Nation 


51 | 


;2.3) 


49 1 


(2.3) 


12( 


(1.2) 


o r~) 



The achievement levels correspond to the following points on the NAEP reading scale at grade 8: Basic, 243-280; 
Proficient , 281-322; and Advanced, 323 and above. The standard errors of the statistics in the table appear in parentheses. 
**** Standard error estimates cannot be accurately determined. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1998 Reading 
Assessment. 




NAEP 1998 READING STATE REPORT 



35 



Massachusetts 



Free/Reduced-Price Lunch Program Eligibility 

NAEP tracks eligibility for the federal program providing free or reduced-price school 
lunches. The free/reduced-price lunch component of the National School Lunch 
Program (NSLP) offered through the U.S. Department of Agriculture (USDA), is 
designed to ensure that children near or below the poverty line receive nourishing meals. 
This program is available to public schools, nonprofit private schools, and residential 
child care institutions. Eligibility is determined through the USDA’s Income Eligibility 
Guidelines, and results for this category of students are included as an indicator of 
poverty. More information is available at the USDA Web site, in particular, in a 
question-and-answer style document called “Nutrition Program Facts” at 
http://www.usda.gov/fcs/cnp/schoolt2.htm. NAEP first collected information on 
participation in this program in 1996. 

NAEP collects data on student eligibility for the NSLP in five categories: eligible 
for reduced-price lunches, eligible for free lunches, not eligible for the NSLP, 
information was not available, or schools did not provide the information. Because some 
of these groups were small, these categories were combined into eligible, not eligible, 
and information not available, as reported here for groups meeting minimum sample size 
requirements. 

Scale Score Results by Eligibility for the Free/Reduced-Price Lunch 
Program 

In terms of average reading scale scores for Massachusetts’ public school students in 
1998, Table 5A shows the following. 

Public School Students , Grade 4 

• Students in Massachusetts eligible for free/reduced-price lunch had an average 
reading scale score of 205. This was lower than that of students not eligible for this 
program (233). 

• Students in Massachusetts eligible for free/reduced-price lunch had an average scale 
score (205) that was higher than that of similar fourth-grade students in the nation 
(198). 



Public School Students , Grade 8 

• In Massachusetts, the average reading scale score of students eligible for 
free/reduced-price lunch was 248. This was lower than that of students not eligible 
for this program (276). 

• Students in Massachusetts eligible for free/reduced-price lunch had an average scale 
score (248) that did not differ significantly from that of similar eighth graders 
nationwide (246). 
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TABLE 5A 



State Assessment 



Average reading scale scores and selected percentiles by 
free/reduced-price lunch eligibility: 1998 



Percentage 
of total 
population 



Average 

scale 

score 



10th 

percentile 



Scale score distribution 



25th 

percentile 



50th 

percentile 



75th 

percentile 



90th 

percentile 



Eligible 
Grade 4 






























1998 Massachusetts 


27 ( 


1.8) 


205 


(2.1) 


164 


(2.6) 


186 i 


( 1-8) 


206 


(2.8) 


227 


(1.6) 


246 


(5.7) 


Northeast 


33 ( 


3.8) 


208 


(2.5) 


164 


(4.3) 


187 i 


(2.5) 


208 


(2.7) 


230 


(4.4) 


249 


(3.6) 


Nation 


38 { 


1.3) 


198 


1.2) 


150 


(2.7) 


175 1 


(1-6) 


200 


(1.7) 


224 i 


( 1-8) 


243 


( 1-5) 


Grade 8 






























1998 Massachusetts 


23 { 


1.7) 


248 < 


(2.1) 


209 


(3.4) 


229 1 


( 3.0) 


249 


(3.3) 


269 i 


(5.7) 


285 


(2.1) 


Northeast 


23 ( 


1.6) 


247 l 


(2.3) 


202 


(8.4) 


227 l 


(5.6) 


249 


(2.3) 


270 i 


(3.9) 


289 


(4.2) 


Nation 


30 ( 


0.8) 


246 { 


( 1*3) 


201 


( 1-9) 


224 | 


(2.1) 


248 i 


(1.7) 


270 i 


(1.0) 


288 i 


( 1-6) 


Not eligible 
Grade 4 






























1998 Massachusetts 


68 ( 


2.3) 


233 | 


(1.3) 


198 ■ 


(3.2) 


216 | 


(2.2) 


235 i 


(1.3) 


253 1 


(10) 


268 i 


( 1:6) 


Northeast 


57 ( 


6.3) 


233 { 


: i.5) 


191 i 


(3.6) 


211 | 


(2.6) 


235 i 


(2.3) 


256 1 


(2.4) 


272 1 


(4.2) 


Nation 


54 ( 


1.9) 


226 < 


: i.o) 


181 i 


(1.7) 


205 { 


( 1-5) 


229 1 


(ID 


250 1 


(1.0) 


267 | 


(ID 


Grade 8 






























1998 Massachusetts 


73 ( 


2.0) 


276 { 


: i.4) 


239 l 


( 1-8) 


257 j 


(2.0) 


276 | 


(1.8) 


296 | 


(1-7) 


311 | 


(2.6) 


Northeast 


62 ( 


4.1) 


273 ( 


[2.2) 


234 | 


(4.7) 


254 ( 


(2.7) 


276 | 


(2.6) 


295 < 


(2.8) 


311 < 


(2.2) 


Nation 


58 ( 


1.8) 


269 ( 


: i.o) 


226 < 


( 14) 


249 ( 


: i.i) 


272 1 


(1.0) 


291 < 


(1.1) 


308 | 


( 1.4) 


Information not 
available 
Grade 4 






























1998 Massachusetts 


5< 


2.0) 


226 ( 


: 5 . 9 )! 


. 188 | 


; 3.5)1 


205 ( 


9.1)1 


226 1 


: 9 . 0)1 


248 < 


( 5.4)1 


264 ( 


: 4 . 3 )! 


Northeast 


10 ( 




237 { 


18)1 


199 < 


( 4.7)1 


221 ( 


: 3 . 9 )! 


240 < 


: 5 . 5 )! 


257 ( 


( 2.2)1 


272 < 


: 2 . 6 )! 


Nation 


7(1.9) 


225 ( 


4.0)1 


177 ( 


; 4.0)1 


203 ( 


6.0)1 


227 ( 


(5.1)1 


251 < 


(4.7)1 


268 < 


: 4.4)1 


Grade 8 






























1998 Massachusetts 


4(1.7) 


269 (14.0)1 


222 < 


: 8.5)i 


245 (12.0)1 


269 < 


: 8.8)1 


291 (18.8)1 


311 (24.0)1 


Northeast 


15(5.0) 


272 (4.1)! 


229 < 


: 5 . 9 )! 


250 ( 7.9)1 


276 < 


: 2.4)1 


295 ( 1.6)1 


311 ( 5.2)1 


Nation 


12 ( 1.9) 


265 { 2.7) 


216 ( 


4.4) 


243 ( 3.8) 


269 ( 


2 .8) 


290 ( 3.4) 


307 ( 2.4) 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics in the table appear in parentheses. 
! Interpret with caution — the nature of the sample does not allow accurate determination of the variability of this statistic. 
**** Standard error estimates cannot be accurately determined. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 199S Reading 
Assessment. 
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Achievement Level Results by Eligibility for the Free/Reduced-Price Lunch 
Program 

In terms of achievement levels attained by public school students in 1998, Table 5B 

indicates the following. 

Public School Students, Grade 4 

• In Massachusetts, 15 percent of students who were eligible for the 
free/reduced-price lunch program and 45 percent of students who were not eligible 
for this service performed at or above the Proficient level. These percentages were 
significantly different. 

• For students in Massachusetts who were eligible for the free/reduced-price lunch 
program, the percentage at or above the Proficient level (15 percent) was not 
significantly different from the corresponding percentage for their national 
counterparts (13 percent). 

Public School Students, Grade 8 

• In Massachusetts, 14 percent of students who were eligible for the 
free/reduced-price lunch program and 43 percent of students who were not eligible 
performed at or above the Proficient level. These percentages were significantly 
different. 

• For students who were eligible for the free/reduced-price lunch program, the 
percentage at or above the Proficient level in Massachusetts (14 percent) was not 
significantly different from the corresponding percentage for eligible students 
nationwide (15 percent). 
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TABLE 5B 


Percentages of public school students attaining achievement levels 
by free/reduced-price lunch eligibility: 1998 


State Assessment 



Below Basic 



At or Above 
Basic 



At or Above 
Proficient 



Advanced 





r ' 










Eligible 
Grade 4 












1998 Massachusetts 


52 ( 3.2) 


48 


(3.2) 


15(2.4) 


2 { 0.9) 


Northeast 


49 ( 3.7) 


51 


(3.7) 


18 ( 3.9) 


2(1.1) 


Nation 


58 ( 1.5) 


42 


(1.5) 


13 ( 1.2) 


1 ( 0.4) 


Grade 8 












1998 Massachusetts 


42 ( 3.0) 


58 


(3.0) 


14(2.0) 


o 


Northeast 


43 ( 2.4) 


57 


(2.4) 


15(2.1) 


1 <••••> 


Nation 


44 ( 1.6) 


56 


(1.6) 


15 ( 1.0) 


o r *•) 


Not eligible 
Grade 4 












1998 Massachusetts 


17 ( 1.4) 


83 i 


( 14) 


45 ( 2.2) 


10 ( 1.0) 


Northeast 


22 ( 1.8) 


78 | 


(1.8) 


46 ( 2.9) 


13 ( 2.0) 


Nation 


28 ( 1.3) 


72 1 


( 1-3) 


39 ( 1.3) 


10 ( 0.9) 


Grade 8 












1 998 Massachusetts 


12 ( 1.3) 


88 1 


(1.3) 


43 ( 2.3) 


4 ( 0.8) 


Northeast 


16 ( 2.4) 


84 1 


(2.4) 


43 ( 2.3) 


4(1.6) 


Nation 


20 ( 1 .0) 


80 { 


(1.0) 


38 ( 1.4) 


3 ( 0.6) 


Information not available 
Grade 4 












1998 Massachusetts 


29 ( 8.1)! 


71 ( 


: si)! 


37 ( 8.7)! 


8 ( 3.5)! 


Northeast 


15 ( 2.4)! 


86 { 


: 2.4)! 


54 ( 5.4)! 


13 (3.4)! 


Nation 


30 ( 4.0)! 


70 ( 


: 4.0)! 


38 ( 6.3)! 


10 { 2.0)! 


Grade 8 












1998 Massachusetts 


24 ( 8.7)! 


76 ( 


: 8.7)! 


37 (18.3)1 


7 r**)i 


Northeast 


19 ( 5.8)! 


81 ( 


5.8)! 


44 ( 4.3)! 


5(3.1)! 


Nation 


25 ( 3.1) 


75 ( 


3.1) 


35 ( 2.9) 


4 ( 0.9) 



The achievement levels correspond to the following points on the NAEP reading scale at grade 4 (and 8): Basic , 208-237 
(243-280); Proficient , 238-267 (281-322); and Advanced, 268 (323) and above. The standard errors of the statistics in 
the table appear in parentheses. ! Interpret with caution — the nature of the sample does not allow accurate determination 
of the variability of this statistic. **** Standard error estimates cannot be accurately determined. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1998 Reading 
Assessment. 
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Type of Location 

Attention has been given recently to America’s urban schools, often with the perception 
that these schools and their students compare less favorably to their nonurban 
counterparts. 9 Information on students according to school location is important to the 
efforts to ensure equal access to a high quality education for all. NAEP public school 
location is based on both the NCES Common Core of Data (CCD) and the Quality 
Education Data (QED) file, as drawn from U.S. Census data and definitions. 

Schools that participated in the assessment were classified into three mutually 
exclusive types of geographic location— Central City, Urban Fringe/Large Town, and 
Rural/Small Town. General information (including definitions) about these categories 
and schools’ categorization within them can be found in the technical reports for the 
1996 NAEP state assessments in Chapter 3, “Sample Design and Selection.” 

Information on urbanicity specific to the 1998 state assessment will be available in the 
NAEP 1998 Technical Report. 

Table 6A presents fourth- and eighth-grade scale score results according to the 
location type of the schools that students attended in Massachusetts and the nation. 

Scale Score Results by Type of Location 

In terms of average reading scale scores for public school students in Massachusetts, 
Table 6A reveals the following. 

Public School Students, Grade 4 

• In 1998 in Massachusetts, the average reading scale score of students attending 
schools in central cities was lower than those of students in urban fringes/large towns 
and rural areas/small towns. 

• The average scale scores of students attending schools in all three types of locations 
in Massachusetts did not differ significantly in 1998 from those in 1992. 

• The average scale scores of students attending schools in all three types of locations 
in Massachusetts did not differ significantly in 1998 from those in 1994. 

Public School Students, Grade 8 

• In Massachusetts in 1998, the average reading scale score of students attending 
schools in central cities was lower than those of students in urban fringes/large towns 
and rural areas/small towns. 
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9 U.S. Department of Education, National Center for Education Statistics (1996). Urban schools: The challenge of location 
and poverty (NCES Publication No. 96-184). Washington, DC: U.S. Government Printing Office. 
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TABLE 6A 



Average reading scale scores and selected percentiles for public 
school students by type of location: 1992 to 1998 



Percentage 
of total 
population 



Average 

scale 

score 



10th 

percentile 



Scale score distribution 



25th 


50th 


75th 


90th 


percentile 


percentile 


percentile 


percentile 



Central city 
Grade 4 

1998 Massachusetts 


25 


(2.2) 


co 

o 

CM 


(3.0) 


166 


(4.7) 


188 i 


(3.6) 


210 i 


(3.4) 


232 i 


(4.7) 


250 


(3.4) 


Nation 


33 


1.8) 


208 


1.8) 


158 


(5.0) 


183 i 


(2.4) 


209 i 


(1-4) 


234 i 


(2.5) 


255 


(2.3) 


1994 Massachusetts 


25 


(2.5) 


201 


3.3) 


152 i 


(4.6) 


175 i 


(4.5) 


202 i 


(3.7) 


227 i 


(3.6) 


248 


(3.0) 


Nation 


34 


(2.1) 


203 


(2.4) 


145 i 


(2.6) 


174 i 


(3.1) 


208 i 


(3.0) 


235 i 


(2.7) 


256 


(2.0) 


1992 Massachusetts 


25 


1.9) 


208 


(2.0) 


169 i 


(3.1) 


189 1 


( 1.4) 


209 i 


(2.9) 


229 i 


(3.8) 


247 


(3.1) 


Nation 


32 


(2.8) 


207 


1.5) 


159 i 


(2.6) 


183 1 


(2.6) 


209 i 


(1.9) 


232 i 


(1-9) 


253 


(2.6) 


Grade 8 

1998 Massachusetts 


' 26 i 


( 1-4) 


254 i 


(3.3) 


212 i 


(3.9) 


231 1 


(3.0) 


254 i 


(3.7) 


277 1 


(3.6) 


298 


(7.7) 


Nation 


32 i 


( 1.6) 


254 i 


(1.7) 


205 i 


(2.6) 


230 1 


(1.9) 


257l 


( 1.2) 


281 i 


( 1-4) 


299 


(2.3) 


Urban fringe/ 
large town 
Grade 4 

1998 Massachusetts 


42 l 


( 2.2)< 


231 | 


(1-9) 


192 l 


(4.4) 


212 l 


(2.2) 


232 l 


(1.4) 


252 I 


(1.9) ' 


269 


(1.6) 


Nation 


35 | 


( 2.5)< 


220 1 


( 1.8) 


168 l 


(2.8) 


197 l 


(2.8) 


224 1 


(2.2) 


248 l 


(1.9) 


266 


( 1.9) 


1994 Massachusetts 


59 l 


(4.2) 


231 | 


( 1.4) 


192 i 


( 1.6) 


212 1 


(2.3) 


233 1 


(1.5) 


252 l 


(1.6) 


267 


( 1-5) 


Nation 


43 l 


(2.5) 


219 1 


( 1.9) 


166 l 


(4.1) 


196 1 


(3.0) 


223 1 


(1.1) 


246 1 


(1.7) 


265 


(3.0) 


1992 Massachusetts 


45 | 


(3.9) 


232 1 


( 1.3) 


196 l 


(3.4) 


214 1 


(1.5) 


233 1 


( 1.8) 


250 1 


( 1-9) 


265 


(0.9) 


Nation 


40 | 


( 3.6) 


219 l 


(2.2) 


173 1 


(4.4) 


196 1 


(2.1) 


222 1 


(2.6) 


244 1 


( 1-9) 


263 


(3.5) 


Grade 8 

1998 Massachusetts 


43 1 


(2.2) 


275 < 


: 2.4) 


237 i 


(3.4) 


256 1 


(2.9) 


275 1 


(2.8) 


295 1 


(2.4) 


311 


(3.7) 


Nation 


■ 40 < 


(2.0) 


266 1 


; i.4) 


222 ( 


(2.0) 


245 1 


(2.3) 


269 1 


(1.6) 


289 1 


( 1.0) 


306 


(1.8) 


Rura i/s mall town 
Grade 4 

1998 Massachusetts 


33 1 


: 3.2)> 


231 1 


; 1 . 9 ) 


195 1 


(5.8) 


214 1 


: 1.8) 


234 1 


(2.6) 


251 1 


(1-8) 


266 


( 1-0) 


Nation 


32 1 


; 2 . 1 )> 


218 1 


: 1 . 2 ) 


172 1 


( 1*3) 


196 1 


: 1.2) 


221 1 


(1.7) 


243 1 


(1-6) 


261 


( 1.7) 


1994 Massachusetts 


161 


(3.8) 


230 1 


: 2 . 7 )! 


188 ( 


( 5.2)! 


210 1 


: 3.8)! 


231 1 


: 3.7)! 


252 1 


: 3.4)! 


269 


( 3.9)! 


Nation 


23 1 


(2.3) 


2131 


: i.8) 


162 ( 


(3.0) 


189 1 


(2.8) 


217 1 


: i.8) 


240 1 


(2.1) 


260 


(2.1) 


1992 Massachusetts 


30 1 


(4.0) 


232 1 


: i.8) 


197 ( 


(2.6) 


214 1 


(3.0) 


232 1 


(3.4) 


251 1 


(2.7) 


265 


(2.5) 


Nation 


28 ( 


; 2 . 6 ) 


218 1 


: 2 . 4 ) 


173 1 


(2.9) 


197 1 


(4.3) 


220 1 


(2.1) 


240 1 


(2.6) 


258 


(3.3) 


Grade 8 

1998 Massachusetts 


30 ( 


(2.1) 


274 1 


: 2 . 4 ) 


238 1 


(2.1) 


256 1 


(3.8) 


275 1 


(2.6) 


293 1 


(4.5) 


309 


(2.6) 


Nation 


28 ( 


: i.6) 


263 1 


: 1 . 5 ) 


218 1 


(3.4) 


241 1 


(1.6) 


266 1 


(1-9) 


286 1 


(1.5) 


305 


(19) 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics in the table appear in parentheses. 
If the notation >(<) appears, it signifies that the 1998 value was significantly higher (lower) than the value for 1994 at 
about the 95 percent confidence level. If the notation »(«) appears, it signifies that the 1998 value was significantly higher 
(lower) than the value for 1992 at about the 95 percent confidence level. Characteristics of the school sample do not 
permit reliable regional results for type of location. ! Interpret with caution — the nature of the sample does not allow 
accurate determination of the variability of this statistic. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992, 1994, 
and 1998 Reading Assessments. 
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Achievement Level Results by Type of Location 

In terms of achievement levels for public school students in Massachusetts, Table 6B 

indicates the following. 

Public School Students, Grade 4 

• In 1998, the percentage of students attending schools in central cities in 
Massachusetts who performed at or above the Proficient level was smaller than the 
corresponding percentages for students in urban fringes/large towns and rural 
areas/small towns. 

• The percentages of students attending schools in all three types of locations in 
Massachusetts who performed at or above the Proficient level did not differ 
significantly in 1998 from those in 1992. 

• The percentages of students attending schools in all three types of locations in 
Massachusetts who performed at or above the Proficient level did not differ 
significantly in 1998 from those in 1994. 

Public School Students, Grade 8 

• For students who attended schools in central cities in Massachusetts, the percentage 
at or above the Proficient level was smaller than the corresponding percentages for 
students in urban fringes/large towns and rural areas/small towns. 
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Percentages of public school students attaining achievement levels 
by type of location: 1992 to 1998 








Below Basic ! 


At or Above 

Basic M or Above 

Proficient Advanced 



Central city 
Grade 4 

1998 Massachusetts 


48 ( 4.0) 


52 ( 4.0) 


19 


(2.8) 


3 ( 0.8) 


Nation 


49 ( 2.1) 


51 (2.1) 


22 


( 1-9) 


4 ( 0.6) 


1994 Massachusetts 


57(4.1) 


43(4.1) 


16 


(2.5) 


3(1-3) 


Nation 


50 ( 2.7) 


50 ( 2.7) 


22 


(2.0) 


5 ( 0.9) 


1992 Massachusetts 


49 ( 3.2) 


51 ( 3.2) 


17 


(2.3) 


2 ( 0.7) 


Nation 


49 ( 2.0) 


51 ( 2.0) 


20 


( 1-4) 


4 ( 0.7) 


Grade 8 

1998 Massachusetts 


37 ( 3.2) 


63 ( 3.2) 


21 


(4.2) 


2 (•***) 


Nation 


36 ( 2.0) 


64 ( 2.0) 


25 


(1.4) 


2 ( 0.4) 


Urban frlnge/large town 
Grade 4 

1998 Massachusetts 


21 ( 2.4) 


79 ( 2.4) 


42 i 


(2.8) 


11 ( 1.4) 


Nation 


34 ( 2.1) 


66(2.1) 


35 i 


( 1-8) 


9 ( 0.9) 


1994 Massachusetts 


22 ( 1.8) 


78 ( 1.8) 


43 i 


(2.0) 


10 ( 1.5) 


Nation 


35 ( 1 .8) 


65 ( 1.8) 


33 1 


(2.0) 


S ( 1.1) 


1992 Massachusetts 


18 ( 1.6) 


82 ( 1.6) 


42 1 


(2.4) 


8(1.0) 


Nation 


36 ( 2.5) 


64 ( 2.5) 


31 1 


(2.7) 


7(1.2) 


Grade 8 

1998 Massachusetts 


14 ( 2.2) 


86 ( 2.2) 


42 1 


(3.6) 


4 ( 1.2) 


Nation 


23 ( 1.6) 


77 ( 1.6) 


35 | 


(1.6) 


3 ( 0.7) 


Rural/small town 
Grade 4 

1998 Massachusetts 


19 ( 2.2) 


81 ( 2.2) 


43 { 


(4.1) 


8 ( 1.1) 


Nation 


35 ( 1 .8) 


65 ( 1.8) 


30 ( 


: 2 . 2 ) 


6 ( 0.7) 


1994 Massachusetts 


24 ( 2.6)! 


76 ( 2.6)! 


41 ( 


: 4.8)! 


11 ( 1.9)1 


Nation 


41 ( 2.6) 


59 ( 2.6) 


27 ( 


( 2.0) 


6 ( 0.7) 


1992 Massachusetts 


19 ( 2.3) 


81 ( 2.3) 


42 ( 


(3.1) 


8( 1.8) 


Nation 


36 ( 2.5) 


64 ( 2.5) 


28 ( 


2.6) 


5 ( 1.5) 


Grade 8 

1998 Massachusetts 


13 (2.1) 


87 (2.1) 


41 ( 


3.8) 


3(1.2) 


Nation 


26 { 1 .8) 


74 ( 1.8) 


31 ( 


: 1.7) 


2 ( 0.5) 



The achievement levels correspond to the following points on the NAEP reading scale at grade 4 (and 8): Basic, 208-237 
(243-280); Proficient, 238-267 (281-322); and Advanced, 268 (323) and above. The standard errors of the statistics in 
the table appear in parentheses. If the notation >(<) appears, it signifies that the 1998 value was significantly higher 
(lower) than the value for 1994 at about the 95 percent confidence level. If the notation »(«) appears, it signifies that the 
1998 value was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
Characteristics of the school sample do not permit reliable regional results for type of location. ! Interpret with 
caution — the nature of the sample does not allow accurate determination of the variability of this statistic. **** Standard 
error estimates cannot be accurately determined. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992, 1994, 
and 1998 Reading Assessments. 
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Type of School 

The 1994 NAEP assessment marked the first time that nonpublic school students were 
assessed at the state level. Massachusetts met the participation guidelines for reporting 
nonpublic school results for the reading assessments in 1994 and 1998 at grade 4.' 0 
Results are reported for nonpublic schools and also for public and nonpublic schools 
combined. Massachusetts’ nonpublic schools did not meet the participation guidelines 
for grade 8 in 1998. 

In 1998, approximately 11 percent of fourth graders in Massachusetts attended 
nonpublic schools. For the nation, 1 1 percent of students at grade 4 attended nonpublic 
schools in 1998. 

The reader should not make inferences about any apparent differences in 
performance between students attending public schools and those attending nonpublic 
schools. Such differences may be related to socioeconomic and sociological factors, 
such as the level of parental involvement in a child’s education. 

Additional information on nonpublic schools, including disaggregation by type of 
nonpublic school, is in the NAEP 1998 Reading Report Card. 

Table 7A presents scale score results for students in public schools, in nonpublic 
schools, and for students in public and nonpublic schools combined. 

Scale Score Results by Type of School 

In terms of average reading scale scores for Massachusetts’ students, Table 7A provides 
the following information. 

Public and Nonpublic School Students , Grade 4 

• In 1998, the average scale score for students in nonpublic schools in Massachusetts 
was 233. This was not significantly different from that for students in public schools 
(225). 

• The average scale score for Massachusetts’ nonpublic school students (233) was not 
significantly different from that for students in the nation’s nonpublic schools (233) 
in 1998. 

• The average scale score for students in Massachusetts’ nonpublic schools did not 
differ significantly in 1998 (233) from that in 1994 (238). 




10 The NAEP 1998 Reading Report Card contains full information on the participation guidelines in Appendix A. The 
Report Card is available at http://nces.ed.gov/naep/. 
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TABLE 7 A 



State Assessment 



Average reading scale scores and selected percentiles for students 
by type of school: 1994 and 1998 



Percentage 


Average 




Scale score distribution 






of total 


scale 


10th 


25th 


50th 1 75th 


90th 


population 


score 


percentile 


percentile 


percentile | percentile 


percentile 



Public 


























Grade 4 


























1998 Massachusetts 


89 { 1.4) 


225 { 1.4) 


184 


(3.2) 


206 


(1.9) 


227 


( 1-4) 


248 


( 16) 


265 


( 1-4) 


Northeast 


85 { 3.0) 


225 { 1.6)> 


180 


( 3.2)> 


202 


( 2.2)> 


227 


( 2.0)> 


250 


( 1 8)> 


267 


(2.5) 


Nation 


89 { 1.2) 


215 ( 0.8)> 


165 


( 2.2)> 


192 


( 1-1)> 


218 i 


(0.9) 


242 


( 10) 


261 


( 1-3) 


1994 Massachusetts 


91 { 0.8) 


223 ( 1.3) 


177 


(2.3) 


202 


(3.0) 


226 i 


(1.6) 


248 


( 1-6) 


265 


(2.1) 


Northeast 


86 { 2.2) 


212 (2.2) 


154 i 


(4.8) 


186 


(3.6) 


217 i 


(2.3) 


242 


(2.8) 


261 i 


(2.4) 


Nation 


90 { 0.9) 


212 ( 1.1) 


156 i 


(2.1) 


187 i 


( 15) 


217 i 


(1.2) 


241 i 


( 1-2) 


261 i 


( 1-5) 


NonpubUc 


























Grade 4 


























1998 Massachusetts 


11(14) 


233 ( 4.4) 


198 1 


(6.2) 


216 i 


(5.8) 


235 1 


( 8.0) 


253 i 


(3.0) 


267 i 


(4.3) 


Northeast 


15 ( 3.0) 


230 ( 4.5)! 


185 1 


( 6.3)! 


208 i 


( 5.4)! 


232 | 


(2.7)! 


256 i 


( 3.4)! 


274 | 


( 4.3)! 


Nation 


11 ( T2) 


233 ( 2.3) 


187| 


(4.3) 


211 l 


(4.2) ‘ 


235 | 


(2.4) 


256 1 


(2.0) 


274 | 


(3.3) 


1994 Massachusetts 


9 { 0.8) 


238 { 4.9) 


198 { 


(9.3) 


219 1 


(4.8) 


240 { 


(4.7) 


258 1 


(4.0) 


275 l 


(4.2) 


Northeast 


14 { 2.2) 


233 { 5.4) 


190 1 


(6.9) 


214 1 


(4.9) 


235 I 


(6.0) 


256 1 


(4.7) 


273 1 


(3.9) 


Nation 


10 { 0.9) 


231 ( 2.5) 


188 | 


(4.2) 


211 | 


(2.5) 


233 | 


(2.3) 


254 | 


(1.9) 


272 | 


(2.7) 


Combined 


























Grade 4 


























1998 Massachusetts 


ioo r**) 


226 { 1 .4) 


185 1 


(2.7) 


207 1 


(1-5) 


228 ( 


(2.1) 


248 | 


(1.7) 


265 \ 


(1.1) 


Northeast 


100 (****) 


226 ( 1.4)> 


181 ( 


( 3.3)> 


203 1 


( 2.0)> 


228 < 


: i.4)> 


251 | 


(1.8) 


268 1 


(2.9) 


Nation 


100 {•**•) 


217 { 0.8)> 


167 < 


(1.6)> 


193 ( 


( 0.9)> 


220 ( 


: i.o) 


244 | 


(0.9) 


263 ( 


: 1.0) 


1994 Massachusetts 


ioo r**) 


225 ( 1.3) 


179 ( 


(2.7) 


203 ( 


: 1.4) 


228 < 


(0.9) 


249 ( 


(1.1) 


266 ( 


(1.5) 


Northeast 


ioo (****) 


215 ( 2.1) 


159 ( 


(4.3) 


190 ( 


(2.5) 


219 ( 


2.0) 


244 { 


(2.4) 


264 ( 


(3.6) 


Nation 


100 (****) 


214 ( 1.0) 


159 ( 


: i.6) 


189 ( 


(1.2) 


219 ( 


: i.i) 


243 ( 


(1.1) 


263 ( 


(15) 



The Combined sample may include students attending Bureau of Indian Affairs (BIA) schools and/or Department of 
Defense (DoDEA/DDESS) schools. These students are not included in either the Public or the Nonpublic sample. The 
NAEP reading scale ranges from 0 to 500. The standard errors of the statistics in the table appear in parentheses. If the 
notation >(<) appears, it signifies that the 1998 value was significantly higher (lower) than the value for 1994 at about 
the 95 percent confidence level. ! Interpret with caution — the nature of the sample does not allow accurate determination 
of the variability of this statistic. **** Standard error estimates cannot be accurately determined. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1994 and 1998 
Reading Assessments. 
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Achievement Level Results by Type of School 

In terms of achievement levels attained by Massachusetts’ students, Table 7B shows the 

following. 

Public and Nonpublic School Students Grade 4 

• In Massachusetts, the percentage of nonpublic school students who were at or above 
the Proficient level in 1998 was 46 percent. This was not significantly different 
from the corresponding percentage for students in public schools (37 percent). 

• In 1998, the percentage of nonpublic school students at or above the Proficient level 
in Massachusetts (46 percent) was not significantly different from the corresponding 
percentage for students in the nation’s nonpublic schools (46 percent). 

• The percentage of students performing at or above the Proficient level in 
Massachusetts’ nonpublic schools did not differ significantly in 1998 (46 percent) 
from that in 1994 (53 percent). 
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TABLE 7B 


(! 


Percentage of students attaining achievement levels by type of 
school: 1994 and 1998 


State Assessment 



Below Basic 



At or Above 
Basic 



At or Above 



Proficient 



Advanced 



Public 


















Grade 4 


















1998 Massachusetts 


27 


( 1.8) 


73 i 


( 18) 


37 


(2.0) 


8 i 


(0.8) 


Northeast 


30 i 


( 1-8)< 


70 1 


( 1 8)> 


37 i 


( 2.0)> 


10 i 


(1-3) 


Nation 


39 i 


( i.o) 


61 i 


( 10) 


29 i 


(0.9) 


6 i 


(0.5) 


1994 Massachusetts 


31 i 


( 1.5) 


69 I 


( 1.5) 


36 i 


(1.7) 


8 1 


(1-0) 


Northeast 


42 i 


(2.3) 


58 | 


(2.3) 


28 i 


(2.6) 


7 | 


(1.5) 


Nation 


41 i 


( 1.1) 


59 I 


(1.1) 


28 i 


(1.2) 


71 


(0.7) 


Nonpubiic 


















Grade 4 


















1998 Massachusetts 


181 


(5.7) 


82 I 


(5.7) 


46 1 


(7.9) 


10 1 


(3.5) 


Northeast 


25 1 


( 4.6)1 


75 | 


( 4.6)1 


43 | 


( 4.9)1 


14 1 


( 3.2)1 


Nation 


22 1 


(2.6) 


78 { 


(2.6) 


46 1 


(2.9) 


14 | 


[ 1-5) 


1994 Massachusetts 


15 1 


(4.5) 


85 { 


(4.5) 


53 1 


(6.1) 


16 < 


(4.8) 


Northeast 


20 1 


(4.6) 


80 | 


(4.6) 


47 | 


(6.0) 


14 j 


(3.9) 


Nation 


23 1 


(2.4) 


77 { 


(2.4) 


43 1 


(3.0) 


13 < 


(1-8) 


Combined 


















Grade 4 


















1998 Massachusetts 


26 { 


: i.6) 


74 | 


(1.6) 


38 | 


(2.0) 


8 < 


(0.8) 


Northeast 


30 | 


; i-7)< 


70 ( 


(1.7)> 


38 1 


[1-7)> 


10 < 


: i.2) 


Nation 


38 { 


(0.9) 


62 ( 


: 0.9) 


31 { 


(0.9) 


7 ( 


(0.5) 


1994 Massachusetts 


29 { 


; 1 . 4 ) 


71 ( 


(1.4) 


37 ( 


: i.6) 


9 { 


: i.o) 


Northeast 


39 ( 


(2.1) 


61 ( 


: 2 . 1 ) 


31 ( 


(2.4) 


8 ( 


: i.4) 


Nation 


40 { 


: i.o) 


60 ( 


; i.o) 


30 ( 


(1.1) 


7 ( 


0.7) 



The Combined sample may include students attending Bureau of Indian Affairs (BIA) schools and/or Department of 
Defense (DoDEA/DDESS) schools. These students are not included in either the Public or the Nonpublic sample. The 
achievement levels correspond to the following points on the NAEP reading scale at grade 4 (and 8): Basic , 208-237 
(243-280); Proficient , 238-267 (281-322); and Advanced , 268 (323) and above. The standard errors of the statistics in 
the table appear in parentheses. If the notation >(<) appears, it signifies that the 1998 value was significantly higher 
(lower) than the value for 1994 at about the 95 percent confidence level. ! Interpret with caution — the nature of the 
sample does not allow accurate determination of the variability of this statistic. 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1994 and 1998 
Reading Assessments. 
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Appendix A 



Where to Find More Information 



Below are only a few suggestions for finding additional NAEP results and related 
information. In spring 1999, a hyperlinked version of this section will be available from 
the Web page that introduces the 1998 state reports, http://nces.ed.gov/naep/. Many of 
the reports and data files on the Web will require the use of the (free) Adobe Acrobat 
Reader; for tips on installing the Reader, click on the Help button. 

Details of the NAEP Reading Assessment 

For details of the assessment, refer to the companion report, the NAEP 1998 Reading 
Report Card. Both that report and the NAEP 1998 Reading State Reports are available 
on the NCES Web site, http://nces.ed.gov/naep/. For details of the framework on which 
the reading assessment was developed, see http://www.nagb.org/. Click on the 
Publications button on the left, and then click on Reading Framework for the National 
Assessment of Educational Progress: 1992-1998. 

Late in 1999, technical information about the assessment will be available in the 
NAEP 1998 Technical Report. Until that technical report is available, many questions 
may be answered by searching in the Technical Report of the NAEP 1996 State 
Assessment Program in Mathematics , to be found at 

http://nces.ed.gov/naep/naepl996.html. The mathematics assessment was also on a 
cross-grade scale, so mathematics scaling procedures would be more similar to reading 
than would the scaling procedures in the science assessment (which was on a 
within-grade scale). 

Participation by All Jurisdictions in 1998 

Information on each jurisdiction’s participation rates for schools and students is in 
Appendix A of the companion report, the NAEP 1998 Reading Report Card , to be found 
at http://nces.ed.gov/naep/. Participation rates from previous years are included in the 
Technical Report for the given year. 

Additional Results from the Reading Assessment 

For more findings from the 1998 reading assessments, refer to the 1998 results at 
http://nces.ed.gov/naep/. On the release date, the summary data tables (SDTs) at this 
site will include student and school variables for all jurisdictions, the nation, and the four 
NAEP geographic regions. In the spring of 1999, complete SDTs will be available for 
all jurisdictions, with all background questions cross-tabulated with the major 
demographic reporting variables (for instance, hours of television watched by level of 
parental education or limited English proficiency by race/ethnicity). Summary tables 
will also be available for the jurisdictions’ schools and teachers. Results by the purposes 
for reading will also appear in summary data tables in spring 1999. 
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The variables reported in the State Reports may be found in the summary data 
tables at http://nces.ed.naep/. The variables reported here, with their labels in the tables 
are: 

• Gender. This is DSEX in the data tables. Reports documenting or surveying gender 
differences in reading include NAEP 1996 Trends in Academic Progress at 
http://nces.ed.gov/naep/naepl996.html and The Condition of Education, for instance, 
Indicator 20 at http://nces.ed.gov/pubs/ce/c9620a01.html. 

• Race/Ethnicity. This is DRACE in the tables. An instructive explanation of the 
derivation appears in Appendix A of the Reading Report Card, at 
http://nces.ed.gov/naep/. 

• Students’ Reports of Parents’ Highest Education Level. PARED is a derived 
variable also described in Appendix A of the Reading Report Card. The effect of 
parental education is discussed in a paper by Grissmer, Kirby, Berends, and 
Williamson (1994) at http://www.rand.org/publications/MR/MR535/MR535.html. 

• Free/Reduced-Price Lunch Program Eligibility. The variable reported here is 
SLUNCH1, which is a version of SLUNCH with several of the categories of 
SLUNCH (e.g., reduced and free) combined. A description of the program is 
available at http://www.usda.gov/fcs/cnp/schoolt2.htm. 

• Type of Location. T0L3 is the label in the summary data tables. The TOL variable 
uses data from Common Core of Data (see http://nces.ed.gov/ccd/index.html), 
Private School Survey (see http://nces.ed.gov/surveys/pss.html), and Quality 
Education Data (see http://www.qeddata.com/). 

• Type of School. SCHTYPE is the label in the tables. Note that the Nonpublic 
school sample includes Private and Catholic school students. BIA (Bureau of Indian 
Affairs) and DoDEA (Department of Defense Education Activity) students are in the 
Combined sample only. 

At http://nces.ed.gov/naep/, there is a Help button leading to more information on 
these variables, including how the derived variables were created, and other useful 
information about the summary data tables. 
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Publications from NAEP Reading Assessments 

NAEP also offers various special reports on reading that may be of particular interest 
to teachers. These may be ordered from the source at the end of this section, and some 
of them can be accessed and printed from the Web. 

• Reading Framework for the National Assessment of Educational Progress: 
1992-1998 , from the National Assessment Governing Board (available at 
http://www.nagb.org/) 

• NAEP 1998 Reading Report Card for the Nation and the States , the companion to this 
State Report (available at http://nces.ed.gov/naep/, the NAEP Web site) 

• NAEP 1998 Reading Sample Questions and Student Responses: Results from Public 
School Students in the States and Nationwide , a forthcoming brochure with 
state-level results for the released items 

• The NAEP 1998 Reading Report Card National Highlights , a brochure with student 
samples, covering the national and state NAEP 1998 Reading Assessment (available 
at the NAEP Web site) 

• Listening to Children Read Aloud , Data from NAEP J s Integrated Reading 
Performance Record ( IRPR ) at Grade 4 , results from the 1992 IRPR, a special study 
conducted with a subgroup of fourth graders who participated in the 1992 NAEP 
Reading Assessment (available in print only) 

• Interviewing Children About their Literacy Experiences , Data from NAEP y s 
Integrated Reading Performance Record (IRPR) at Grade 4 , results from the 1992 
IRPR, a special study conducted with a subgroup of fourth graders who participated 
in the 1992 NAEP Reading Assessment (available in print only) 

• Students Selecting Stories: The Effects of Choice in Reading Assessment , results from 
the NAEP Reader Special Survey of the 1994 National Assessment of Educational 
Progress (available at the NAEP Web site) 

For ordering information on these reports, write: 

U.S. Department of Education 
ED Pubs 
P.O. Box 1398 
Jessup, MD 20794-1398 

or call toll free 1-877-4 ED PUBS (1-877-433-7827) 

NAEP reading reports in addition to those listed above are available at 
h ttp : //nee s . ed . go v/n aep /. 
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Sample NAEP Questions for Classroom Use 

Sample reading questions and student responses from the 1994 reading assessment are 
now available at http://nces.ed.gov/naep/; look for the sample questions. There are also 
instructions at this site for copying individual items from the files on the Web into a 
word processor. 

All of the 1998 released items are available now in the Reading Report Card. 

The released items from the 1998 Reading Assessment will appear on the Web in the 
spring of 1999. Also available will be state-level results for the released items at grades 
4 and 8, in a brochure suitable for distribution to schools, NAEP 1998 Sample Questions 
and Student Responses. 
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Appendix B 



Figures from Section 1 



Figures 1-5 are displayed here in full-page format, with legends and titles but without 
figure numbers. In each state report on the Web, these figures will appear in color. 
They may be printed in black-and-white or in color. 



58 

o 

ERJC 



NAEP 1998 READING STATE REPORT 



53 



THE NATION’S 
REPORT 
CARD 



1998 



m 



State Assessment 



Average reading scale scores for public school students at grades 4 and 8 




Grade 4 Grade 4 Grade 4 Grade 8 

SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992, 1994, and 1998 Reading Assessments. 
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Reading achievement level results for public school students at grades 4 and 8 



The bars below contain estimated percentages of students in each NAEP reading achievement category. Each population 
of students is aligned at the point where the Proficient category begins, so that they may be compared at Proficient and above. 
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SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1992, 1994, and 1998 Reading Assessments. 
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Achievement levels for reading: Comparing the percentage of public school students 
at or above the Proficient level in Massachusetts with those in other participating 
jurisdictions at grade 4 in 1998 



Slate Assessment 



The bars below contain estimated percentages of students in each NAEP reading achievement category. Each population 
of students is aligned at the point where the Proficient category begins, so that they may be compared at Proficient and above. 
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Differences between states and other jurisdictions may be partially explained by other (actors not included in this ligure. 



SOURCE: National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 1998 Reading Assessment. 
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Achievement levels for reading: Comparing the percentage of public school students 
at or above the Proficient level in Massachusetts with those in other participating 
jurisdictions at grade 8 in 1998 



The bars below contain estimated percentages of students in each NAEP reading achievement category. Each population 
of students is aligned at the point where the Proficient category begins, so that they may be compared at Proficient and above. 
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